Commit graph

135 commits

Author SHA1 Message Date
Geod24
0fb95b8c27 Usage of WEB macro for License everywhere 2014-10-15 11:30:42 +02:00
Tomoya Tanjo
f23fce0026 Mark std.uni.isRegionalIndicator as safe 2014-10-03 11:23:16 +09:00
Ketmar Dark
6113fba620 Remove comma expression in std.uni 2014-09-08 22:27:06 +02:00
Martin Nowak
401b104cf4 Issue 13232 - avoid expensive template instantiations on module import
- hide std.uni.TrieBuilder instantiations behind functions
2014-08-01 02:15:56 +02:00
Михаил Страшун
8457c1998f Merge pull request #2373 from DmitryOlshansky/gen-uni-nogc
Update std.uni tables generator to use @nogc
2014-07-26 04:34:04 +02:00
Dmitry Olshansky
fcbd6f8c5b Update std.uni tables generator to use @nogc
Enables @nogc isWhite and related functions.
A supplement to pull #2323
2014-07-26 01:43:38 +04:00
Robert burner Schadek
f2c5dbd502 some love for std.string
many functions of std.string had no attributes like pure, safe etc.
additionally, many const arguments where not marked as const.
tabs -> whitespace
removed tail whitespace
Doc Examples to unittest docs

more love for std.string

const to in

squeeze
2014-07-17 09:48:56 +02:00
Dmitry Olshansky
c131da5834 Fix issue 12455 [reg]Bad lowercase mapping for 'LATIN CAPITAL LETTER I WITH DOT ABOVE'
Also as part of a fix restores a test case in string.d
to exactly match older behaviour.

Some extended greek is not upper but title case, yet changes on toUpper.
2014-07-05 02:05:12 +04:00
AndrewEdwards
4d7b8b1e19 Update uni.d
Fix Ddoc: Stray ')' warning.
2014-06-29 17:18:30 +09:00
Andrej Mitrovic
97cdef0eef Fix Issue 12184 - Implement advanced formatting support for std.uni.InversionList. 2014-04-30 22:29:37 +02:00
Andrej Mitrovic
a03326665c Strip spaces. 2014-04-26 16:12:48 +02:00
Dmitry Olshansky
c9f1c42ed3 Use direct slicing for CowArray, makes for faster debug builds/CTFE code.
Also use Gallop search policy for CodepointSets, as it's closer to
to the common cases for merging charsets.
2014-04-23 20:19:52 +04:00
Dmitry Olshansky
6f004740aa Enable latent optimizations in std.uni
Simplify set construction.
2014-04-23 20:19:52 +04:00
Dmitry Olshansky
1a4d897587 Enable again linear scans for small sets in std.regex 2014-04-23 20:19:51 +04:00
Dmitry Olshansky
48e7c9a9ad make simpleCaseFoldings CTFE-able 2014-04-23 20:10:20 +04:00
Dmitry Olshansky
5a90d786ab fix range violation for non-existant sets of length < 2 2014-04-23 20:10:19 +04:00
Dmitry Olshansky
dee35f6b53 introduce simpleCaseFolding to support case-insensitive regex 2014-04-23 20:10:19 +04:00
Martin Nowak
3e06a3bca2 Merge pull request #2020 from DmitryOlshansky/utf-matcher
UTF matchers in std.uni
2014-04-23 12:16:52 +02:00
Dmitry Olshansky
75bb5c898d Avoid comma operator 2014-04-13 15:21:21 +04:00
Dmitry Olshansky
c5b35ec220 Adjust after rebase, tweak DDocs
Drop public for documented unittests
2014-04-13 14:50:47 +04:00
Dmitry Olshansky
21a2d20209 Address problems with issue 314 2014-04-13 14:38:05 +04:00
Dmitry Olshansky
05b9cadf36 another DDoc tweak 2014-04-13 14:38:04 +04:00
Dmitry Olshansky
87703b7577 address review issues
Spelling, style etc.
2014-04-13 14:37:45 +04:00
Dmitry Olshansky
fff184b1cc more checking of UTF errors
Overlong sequences, wrong continuation  for UTF-8.
Lone high surrogate for UTf-16/.
2014-04-13 14:37:10 +04:00
Dmitry Olshansky
8073f8371d test both narrow strings and range of char for matcher trait 2014-04-13 14:37:10 +04:00
Dmitry Olshansky
2ee9871759 hide subMatcher until its API and utility is proven 2014-04-13 14:37:09 +04:00
Dmitry Olshansky
94224ab18b fold in review comments 2014-04-13 14:37:09 +04:00
Dmitry Olshansky
f48af662df @safety bags for utfMatchers
Granularity is horribly high. Auto-inference for templates has the
downside that it, leaves no explanations or reasons for failure.
2014-04-13 14:36:50 +04:00
Dmitry Olshansky
08148b5901 purify std.uni constructs, blocked by std.algortihm.sort 2014-04-13 14:36:21 +04:00
Dmitry Olshansky
ec7bbaeb5d const/pure annotations 2014-04-13 14:31:06 +04:00
Dmitry Olshansky
9d06582f00 workaround stable sort (std.move) not CTFE-able 2014-04-13 14:31:06 +04:00
Dmitry Olshansky
0d29cdc3d6 Introduce UTF Matchers into std.uni.
It's a step zero to get decode-less std.regex.
UTF matchers are efficient functors around a set of
specific tries. Enables processing Unicode characters
without decoding at speeds on par with decoding itself.

Along the way make staticIota at 'package' protected and reuse it.

Fix a shameful typo in setSearcher.
2014-04-13 14:31:05 +04:00
monarchdodra
2b4ab244ef Cover 12428 2014-04-12 14:59:11 +02:00
Dmitry Olshansky
e33cfdb04f Use plain uint array for InversionList
Storage for static data was long since compressed so it no longer plays a role at compile-time.
Memory requirements at run-time are modest anyway.
2014-04-03 01:49:19 +04:00
Jakob Ovrum
bc161b24e6 Enable DDoc for std.uni.byCodePoint
See also #1985
2014-03-23 09:34:09 +09:00
Andrei Alexandrescu
e289a7cdd7 Revert "Merge pull request #1685 from blackwhale/utf8-matcher"
This reverts commit 216ca01ca8, reversing
changes made to d56c1dbc08.
2014-03-15 17:11:17 -07:00
Andrei Alexandrescu
216ca01ca8 Merge pull request #1685 from blackwhale/utf8-matcher
Introduce UTF matchers into std.uni.
2014-03-15 15:32:38 -07:00
Dmitry Olshansky
1b03e409c0 another DDoc tweak 2014-03-16 01:35:00 +04:00
Dmitry Olshansky
0d60e46fa9 address review issues
Spelling, style etc.
2014-03-15 22:26:54 +04:00
k-hara
6f80f6aa03 Add more local imports 2014-03-13 13:13:04 +09:00
Dmitry Olshansky
fa5aa82318 more checking of UTF errors
Overlong sequences, wrong continuation  for UTF-8.
Lone high surrogate for UTf-16/.
2014-03-11 00:40:37 +04:00
Dmitry Olshansky
a9b5c139fb test both narrow strings and range of char for matcher trait 2014-03-10 15:15:39 +04:00
Dmitry Olshansky
6635c8f036 hide subMatcher until its API and utility is proven 2014-03-10 14:47:06 +04:00
Walter Bright
be12a3b1f4 enable Ddoc for byGrapheme 2014-03-08 13:07:19 -08:00
Dmitry Olshansky
528099a600 fold in review comments 2014-03-08 13:55:33 +04:00
Dmitry Olshansky
1e771c06c9 @safety bags for utfMatchers
Granularity is horribly high. Auto-inference for templates has the
downside that it, leaves no explanations or reasons for failure.
2014-03-08 13:55:33 +04:00
Dmitry Olshansky
c264bd6a51 purify std.uni constructs, blocked by std.algortihm.sort 2014-03-08 13:55:33 +04:00
Dmitry Olshansky
cbd9bd3b79 const/pure annotations 2014-03-08 13:55:32 +04:00
Dmitry Olshansky
d0e408d5f4 workaround stable sort (std.move) not CTFE-able 2014-03-08 13:55:32 +04:00
Dmitry Olshansky
1c86ecf0c4 Introduce UTF Matchers into std.uni.
It's a step zero to get decode-less std.regex.
UTF matchers are efficient functors around a set of
specific tries. Enables processing Unicode characters
without decoding at speeds on par with decoding itself.

Along the way make staticIota at 'package' protected and reuse it.

Fix a shameful typo in setSearcher.
2014-03-08 13:55:32 +04:00