Commit Graph

276 Commits

Author SHA1 Message Date
levlam
8b87e8ed56 Allow pre, TextUrl and TextMention entities, containing only new lines. 2021-06-09 20:35:02 +03:00
levlam
3614425c8a Add is_hidden_data_entity function. 2021-06-09 19:59:52 +03:00
levlam
d2f575fc1c Ignore FTP links in get_first_url. 2021-06-04 21:33:20 +03:00
levlam
a630c87178 Add tg URLs parsing. 2021-06-03 18:27:40 +03:00
levlam
ce2202b1cc Remove only_urls parameter from find_entities. 2021-06-03 15:38:26 +03:00
levlam
c9de490c7f Allow dashes in URLs. 2021-06-03 15:21:26 +03:00
levlam
198af82254 Move check_url to LinkManager. 2021-05-25 02:53:25 +03:00
levlam
a6a4eb6616 Don't include SliceBuilder.h in logging.h. 2021-05-17 15:21:11 +03:00
levlam
add28462a0 Fix Slice underflow. 2021-05-14 13:18:52 +03:00
levlam
b48421a7a1 Resplit splittable entities before sending them to the server. 2021-04-28 22:10:39 +03:00
levlam
8039660cfe Reload objects from server if failed to resolve their dependencies. 2021-04-04 03:23:22 +03:00
levlam
f0e7b211c3 Use case-insensitive comparison for short mention entities. 2021-03-20 22:57:34 +03:00
levlam
578b8a4dec Minor performance improvements. 2021-02-14 01:25:17 +03:00
levlam
65b381f7fd Add fast path in fix_formatted_text. 2021-02-13 22:45:11 +03:00
levlam
b07a9efb2e Disable SFTP link highlighting. 2021-02-03 21:08:01 +03:00
levlam
82f0386e73 Move some functions from misc.h to algorithm.h. 2021-01-01 16:01:03 +03:00
levlam
52c1da0a70 Update copyright year. 2021-01-01 15:57:46 +03:00
levlam
905d09d82c Accept non-lowercase end HTML tags. 2020-12-19 13:46:22 +03:00
levlam
8afd5a8508 Disable commands highlighting in the chat with the Replies bot.
GitOrigin-RevId: 398db6133f1c2f23c4367b240bc35e4c499483c8
2020-09-30 04:32:28 +03:00
levlam
bcba0f8f78 Bump enitites fix date again.
GitOrigin-RevId: 28b83e168ee6ce10d6da36650d0956c1309cb7c8
2020-09-17 17:08:01 +03:00
levlam
b575ed9a98 Add static assert for array size.
GitOrigin-RevId: 1f044bd3c05346316d27c7ae0462a2b0d575168a
2020-08-23 21:25:06 +03:00
levlam
3de679b560 Fix MessageEntity::get_type_priority.
GitOrigin-RevId: 175f6e2f1f97e87309add8314321934d744b0493
2020-08-18 11:05:10 +03:00
levlam
cae55c5a54 Fix misprint.
GitOrigin-RevId: 0659d2d6949a03234a0951aca8652dec9a692636
2020-07-13 23:13:41 +03:00
levlam
8a1ffe0cbb Fix remove_invalid_entities.
GitOrigin-RevId: 6cad36ac6017dcc3870411129a1b0512f9351d17
2020-07-13 15:34:56 +03:00
levlam
9cf8aed326 Add check debug logging.
GitOrigin-RevId: a58f888b7af480e3e6da2ce668ef2fd5367857da
2020-05-17 03:00:48 +03:00
levlam
42f88e3b72 Remove whitespaces at the beginning of some entities.
GitOrigin-RevId: b0597524571c15b3ffbfec613cb856bfa6e7a224
2020-05-11 01:31:29 +03:00
levlam
f88735b9a9 Do not highlight parts of float numbers as bank card numbers.
GitOrigin-RevId: cc58f030c6485c393f115fb89a4e9a5b2e6b40b9
2020-05-07 23:11:54 +03:00
levlam
390d66e3d2 Improve match_bank_card_numbers.
GitOrigin-RevId: 1df7c2fc487a66ba12e92d80d63e355d1490cef5
2020-05-05 03:15:30 +03:00
levlam
06e74cfba9 Remove whitespace-only entities added in merge_entities.
GitOrigin-RevId: 8b2dbe05d0758639c4447fbfec038b8350dfda9a
2020-04-22 00:57:00 +03:00
levlam
c1a5285b47 Fix warning.
GitOrigin-RevId: 040b2879b6f120cc948ad6020f91c8ab5995134e
2020-04-21 13:51:17 +03:00
levlam
4e7cd24285 Add support for quiz explanation.
GitOrigin-RevId: ab4346fe3abe5c5abd7234d5b4b3937e995494af
2020-04-03 23:39:50 +03:00
levlam
f42a955d75 Replace some offending characters in all strings.
GitOrigin-RevId: a942e9a71db7b5bc3c1be6b15f9b21d767c3d803
2020-04-08 01:23:05 +03:00
levlam
aad96d536e Fix CHECK.
GitOrigin-RevId: 02effd6bbb16e7b84c9df3f47a98dad94844ddc7
2020-03-30 15:20:37 +03:00
levlam
6518f0448c Fix warnings.
GitOrigin-RevId: 42ec38520b8ed0a040680df56750493bbe4eccc3
2020-03-12 20:34:06 +03:00
levlam
9c67f42682 Add td_api::getMarkdownText.
GitOrigin-RevId: b463cc2c92052c552d66d774450ffa7bb4bc132e
2020-03-12 06:22:14 +03:00
levlam
ed7e486668 Improve parse_markdown_v3 test and fix parse_text_url_entities_v3.
GitOrigin-RevId: 337b87cbb885f92f30c9c95603b0ac37693d104f
2020-03-12 01:44:42 +03:00
levlam
ee0e60e097 Allow to output FormattedText to StringBuilder.
GitOrigin-RevId: 8ffffb2305ebe531f5dcb9118f9333367afb1238
2020-03-11 04:09:23 +03:00
levlam
08a5f1b874 Add fast path for ". " in match_urls.
GitOrigin-RevId: 306419ea1e076f527e924721ef6caa4347c955ff
2020-03-10 17:53:55 +03:00
levlam
83cf2b3dd1 Add text_length function.
GitOrigin-RevId: bf58e5427e0c354e6fdddd4756e67cf7eeaf49a9
2020-03-10 17:43:07 +03:00
levlam
08d32673a3 Add sort_entities function.
GitOrigin-RevId: 0026fb224c77cd895ed8f5c38a99a267efb95f84
2020-03-10 17:38:07 +03:00
levlam
532567a475 Resort entities if needed after rtrim.
GitOrigin-RevId: f3124b2dc72e1b7858dde90133c5313025103603
2020-03-10 17:22:57 +03:00
levlam
718067e218 Remove wrong check from remove_invalid_entities.
GitOrigin-RevId: 843dea6a6668de87287a23532d95e9c6712c5b09
2020-03-10 17:06:22 +03:00
levlam
b2a175463f Improve logging on failed check_is_sorted check.
GitOrigin-RevId: 756039b50c69c4b3d5d07ff7b671801726e4a6dc
2020-03-10 16:43:09 +03:00
levlam
6417510d51 Return all entities in get_message_entities.
GitOrigin-RevId: b08c7a9ab0cfa9a78e450d5cbf3567203abd7d67
2020-03-10 03:51:56 +03:00
levlam
1068cac8f0 Add synchronous td_api::parseMarkdown method.
GitOrigin-RevId: 89f59eda7076959a6bed9db006f895298e2fd66c
2020-03-09 23:55:32 +03:00
levlam
d11882c0cb Prefer continuous ranges as a bank card number.
GitOrigin-RevId: 77eb573fd9580cd79964cecfe879a91178d5a43c
2020-03-05 16:56:17 +03:00
levlam
ae5588bf11 Make webPage.description a formatted text.
GitOrigin-RevId: b64cf0e915f9fdeeadc8cdee8280fcbb236c92bb
2020-03-02 16:05:18 +03:00
levlam
e14d15196c Repait broken entities instead of clearing.
GitOrigin-RevId: 7044b000997b7415f55caa1610c418a76c7ea793
2020-02-25 01:46:30 +03:00
levlam
81d0172f33 Correctly merge new entities.
GitOrigin-RevId: 6ca976a3c17030cffb0c32119389ea5a8c1050ff
2020-02-24 20:26:08 +03:00
levlam
6b21b27cae Add random fix_formatted_text test.
GitOrigin-RevId: 35d2bf822bfebe4221a3495bb83fb2555a984a1c
2020-02-21 16:22:40 +03:00
levlam
185d0fd22f Add more fix_formatted_text tests.
GitOrigin-RevId: c24e52c88921226d63fead4dbf7331921bd8f185
2020-02-21 14:56:26 +03:00
levlam
962ea55765 Support splitting and combining entities and Blockquote entities.
GitOrigin-RevId: ebbc6988020afda9dded513f16ab1f7ca3b9ea35
2020-02-21 12:38:24 +03:00
levlam
48b9f38d4a Return error on incorrect text entities.
GitOrigin-RevId: 46862113571eb16a80ef3bcdf3a6352593dee0dc
2020-02-20 02:26:36 +03:00
levlam
1ead70a883 Fix warning.
GitOrigin-RevId: 4beca3cc956fcee81cc96beffb1630c11c5b1a98
2020-02-15 22:42:19 +03:00
levlam
7b87d84c39 Add find_bank_card_numbers test.
GitOrigin-RevId: 0905d918980d52267fb5cfea627737d22c8ea1d2
2020-02-15 04:07:19 +03:00
levlam
bde94f0940 Simplify adding new entities.
GitOrigin-RevId: 9595a284ae710299161bab639df10f49d49cb386
2020-02-15 03:24:56 +03:00
levlam
824c861e7a Implement find_bank_card_numbers.
GitOrigin-RevId: b77bf505ad4522dcadbb27cacfe62f5a88c3cf44
2020-02-15 02:27:31 +03:00
levlam
30eaa49ffd Update layer to 110. Add textEntityTypeBankCardNumber.
GitOrigin-RevId: 2d525fb0b6639f6b803d381a97f47bd91a12e23e
2020-02-13 18:07:40 +03:00
levlam
8539d43951 Silence warning about wrong message entities for messages from albums.
GitOrigin-RevId: 13a60e258ab6aae8c80d5ea4cd8bb7037f56985c
2020-01-29 02:05:12 +03:00
levlam
faef50b444 Increase approximate entities fix date.
GitOrigin-RevId: dac6e89c9804e74233316c62f23f01c64198965e
2020-01-17 03:13:18 +03:00
levlam
4e22f29c53 Add td_api::getPollVoters.
GitOrigin-RevId: 47ad78287433a2efb9b66f18a960e4de6060842a
2020-01-13 21:21:58 +03:00
levlam
ece4fd0e93 Add message entities tests.
GitOrigin-RevId: fd04d3ebc4619d2b6be4282043a1333d824d7ee6
2020-01-02 17:46:19 +03:00
levlam
80c35676a2 Update copyright year.
GitOrigin-RevId: 09afb551b6e637dc69739fa735b0051a38b9e14c
2020-01-01 04:23:48 +03:00
levlam
3c83e72c49 Add '-' to the list of reserved characters.
GitOrigin-RevId: 97a77a46d7003e53021198bd1b57894df4fa5108
2019-12-25 01:57:33 +03:00
levlam
64f73bebff Better message entities debug.
GitOrigin-RevId: 05fea435da021773ca6fbb76e81680e4913cde51
2019-12-23 19:01:47 +03:00
levlam
2c47242374 Check validness of peer_user_id in secret chats.
GitOrigin-RevId: 299ad87085b8c7b1a1f0de15012e54dfdb2c4d6c
2019-12-16 01:58:57 +03:00
levlam
1bb59a3261 Support new entity types in parse_html.
GitOrigin-RevId: 1a12c3736f4e0921f133b3ac914620b4a01f0efe
2019-12-10 05:46:58 +03:00
levlam
ff51282a50 Remove textEntityTypeBlockQuote from public API.
GitOrigin-RevId: aa718d3c4882e6ce29545e83a6cca8168c66d35a
2019-12-05 15:53:22 +03:00
levlam
2f2c09bf58 Fix CE and warning.
GitOrigin-RevId: 64989213b16f2450678a49e69f3f77d065cb6369
2019-11-02 03:39:14 +03:00
levlam
56c3a2fbed Use td::remove_if.
GitOrigin-RevId: 5cf21381966dc58689a06cc94cb8843fd8087bb9
2019-10-21 16:25:56 +03:00
levlam
99f4abb249 Update to layer 102. Replace LinkState with is_contact/is_mutual_contact.
GitOrigin-RevId: 33061b18ac72711f4df168fb27497bccb36d3367
2019-10-07 22:51:03 +03:00
levlam
1b2e4c79f3 Add basic support for nested entities.
GitOrigin-RevId: 127b89671b4551947552e94bcfdb9cab70ef37c0
2019-10-07 19:45:36 +03:00
levlam
6114516b40 Support PreCode in parse_html.
GitOrigin-RevId: 20a3bcb168ecd45f416e7df17247997eacecbc11
2019-10-03 16:39:50 +03:00
levlam
fdf70df492 Add parse_markdown_v2.
GitOrigin-RevId: ea2ce8bad64becc53d2e6466019469dffec2dc27
2019-10-03 02:31:06 +03:00
levlam
b1d1ea2e6c Support nested entities in parse_html.
GitOrigin-RevId: c8a00262f5a8739d09b45ce710a5c7b920f2bfd4
2019-09-26 18:36:45 +03:00
levlam
3006357f7c Use entity_offset instead of utf16_entity_length.
GitOrigin-RevId: 8e02eac54c534eb33b37ef2b2f345e9c0781164a
2019-09-25 02:05:42 +03:00
levlam
38d5be1ee9 Use Slice in parse_html.
GitOrigin-RevId: f0fa29d7fccf407dde8ec6085a285f1fa2c52aa2
2019-09-25 01:22:04 +03:00
levlam
f20ef8c0c5 Better MessageEntity comparator.
GitOrigin-RevId: 7522f05688c5ff4beee86d4218953dfb5f4a2821
2019-09-23 22:57:02 +03:00
levlam
b13bf0ae7d Split fixing message text in 2 passes.
GitOrigin-RevId: fb0f5f33feebbaab1ccdd54c56412a79e4018066
2019-09-20 02:49:50 +03:00
levlam
87d875ca81 Update layer to 101. New entities type support.
GitOrigin-RevId: c4a4e73d20c27c2ad1440bae2acb9559d1f10a5d
2019-09-19 22:07:11 +03:00
levlam
afb034e512 Remove @ya username.
GitOrigin-RevId: 1c5b9d7f07b420c81a28662197ef757dd96dd263
2019-09-13 20:17:22 +03:00
levlam
79330c3881 Partial ton:// URLs support.
GitOrigin-RevId: eeaaab10574dc636e9de18cc482f2398f6732fa1
2019-09-27 01:03:13 +03:00
levlam
ad167a48ba Pass Slice to parse_url.
GitOrigin-RevId: e6cd357042b827ca56a11bb377c8b07ccd120230
2019-08-05 12:56:28 +03:00
levlam
a7d7882931 Fix misprint.
GitOrigin-RevId: 919dcb9bc3d21c4006a24de32dfc1f6e25056e4f
2019-07-30 00:43:08 +03:00
levlam
981d2bd8fe Better UTF-8 validness checks for text before parsing.
GitOrigin-RevId: 9578d9fb69da619cee706d61687bf904b9cdf2ad
2019-07-27 23:07:10 +03:00
levlam
6cebe30382 Find entities in MESSAGE_ANNOUNCEMENT.
GitOrigin-RevId: 3ca4500dea9ba0f3561470416db21bc1cc42616a
2019-03-26 01:24:23 +03:00
levlam
d6c5dda880 Fix spelling of inaccessible.
GitOrigin-RevId: d28c4c60c365cd453ec89d34519b75abaed169b5
2019-03-15 03:19:10 +03:00
levlam
93494cf048 Fix log messages style.
GitOrigin-RevId: f99e2e838220826d3dea7fdc33c43ac9918a5efd
2019-02-21 18:58:20 +03:00
Arseny Smirnov
20bfcaa979 Use LOG_CHECK where it is necessary
GitOrigin-RevId: a8bd17cc2ee6e43dcea52bb25aef9ee1f91c7ec4
2019-02-12 19:17:20 +03:00
levlam
eaf7e36532 Add fix_formatted_text test.
GitOrigin-RevId: 90e0f7d0fdcef077f88927311a9c0678711c5da8
2019-01-16 21:18:26 +03:00
levlam
2fb5fbfd4c Allow TextURL/TextMention entities consistining only of spaces.
GitOrigin-RevId: fa17848434a90b70e1a10560b367864973bcbdb8
2019-01-16 03:30:42 +03:00
levlam
1b06a66888 Better variable names for "whitespace".
GitOrigin-RevId: 0f4d0c54af87f0813bdad3ab3ff9ee20d056382f
2019-01-15 22:34:38 +03:00
levlam
eaebfad034 Update copyright year.
GitOrigin-RevId: 359e2b43322222922c44c430d3814b0a4c778dc6
2019-01-01 01:02:34 +03:00
levlam
22eb4e1cb2 Remove unneeded reinterpret casts.
GitOrigin-RevId: 54a161ad11e5909f9c06912cf67e6805279f2327
2018-12-20 00:44:15 +03:00
levlam
00c10535a2 Add extract_input_caption method.
GitOrigin-RevId: d49433b0d7d9313bf8f4814c90f28717678b8444
2018-12-12 17:05:32 +03:00
levlam
4f7a52fbb1 Move process_input_caption to MessageEntity.h.
GitOrigin-RevId: 6b5b39d2d82fefbfb6c23df977644c39549ead2e
2018-12-12 16:35:59 +03:00
levlam
6dbef6ef76 Fix returning invalid Unicode from parse_html.
GitOrigin-RevId: 9277022a53d23ac5c3eb1427eb48bd886b789d09
2018-10-09 16:27:40 +03:00
levlam
806e570a72 Add source to next_utf8_unsafe.
GitOrigin-RevId: e8e5a47096461c0e76a64eb26cb848651d4d61e8
2018-10-08 15:53:05 +03:00
levlam
091d7143e3 Fix includes.
GitOrigin-RevId: 68b59141c12d6e24ddaf0fa48008bf58935bd818
2018-09-29 04:41:15 +03:00
levlam
4cf6aba717 Move MessageContent and InputMessageText implementations to corresponding files.
GitOrigin-RevId: d308007a3c850f1969b64a08865787ee7b340b34
2018-09-28 23:57:34 +03:00
levlam
10e4f008b8 Return pointer from get_message_content_text.
GitOrigin-RevId: c1556ee6e58e13e574881585f889744c4be1d4a4
2018-09-28 05:09:28 +03:00
levlam
4597689060 Add Dependencies.h.
GitOrigin-RevId: 791b4dc804a8c0b734b027ff348b16bbfceede5c
2018-09-28 04:21:20 +03:00
levlam
f08c0180b4 Const-correct tl::unique_ptr.
GitOrigin-RevId: b72a92a7169973c2d95e410cfbfed668a412e7e7
2018-09-21 20:52:22 +03:00
levlam
1ab40c7278 Better get_first_url.
GitOrigin-RevId: d153fcd3291758f29a99421f42c1193a51cc248b
2018-07-07 18:01:20 +03:00
levlam
4fb3506792 Safe conversion to user_id in get_link_user_id.
GitOrigin-RevId: 3f0f81deef264b4b0a193cc18ef5bb344490751d
2018-06-30 02:51:13 +03:00
levlam
d2e4f74c52 Match new server parsing of # in URLs.
GitOrigin-RevId: f1e26ad10c80721db14132fd3fc3ba17aa2db509
2018-06-25 03:22:56 +03:00
levlam
a365284831 Support mailto emails.
GitOrigin-RevId: aca706aee9b1adb34f3f25700e91cd0d0880424f
2018-06-25 03:15:38 +03:00
levlam
1ef5c89a91 Allow tg URLs in text links and url buttons.
GitOrigin-RevId: 9708c3016375564e737bf5a8f79494807d61c10f
2018-06-19 13:23:52 +03:00
levlam
4a3784155a td_api::getDeepLinkInfo.
GitOrigin-RevId: edcedaeeaeb54802bb2830343e43ab095f92acaf
2018-04-12 23:51:42 +03:00
levlam
3d02f9d13c Update valid short usernames.
GitOrigin-RevId: b2f1afef1641cc08d41cf621ade203f0fecbc9f9
2018-04-04 18:41:35 +03:00
levlam
92e9550ebd Add source to get_input_message_entities.
GitOrigin-RevId: 505c9c96286e7e6026902cbf1b92f1cc3142f5ad
2018-04-02 01:10:22 +03:00
levlam
a92860a046 Better strip_empty_characters.
GitOrigin-RevId: 35863d02683e75da361712647d643866ae4800cf
2018-03-21 17:54:39 +03:00
levlam
85c2cc160d Add textEntityTypePhoneNumber.
GitOrigin-RevId: b8705ec13104848c5ae0597aee6cf4e6f41762db
2018-03-13 00:17:29 +03:00
levlam
ae319fa10b Cashtag support.
GitOrigin-RevId: c1e55687ce0c977635b77b48940bc6cc0735e02e
2018-03-08 16:28:54 +03:00
levlam
a665c4e822 Implement find_cashtags.
GitOrigin-RevId: 40026a19c1ee1f1ea9c0157d28bdc0b67cbf9c58
2018-03-07 20:29:33 +03:00
levlam
d1f1a14a37 Update layer to 76: add messageWebsiteConnected.
GitOrigin-RevId: 8cb5128a7d7eac2afe0622fc901392bf318fa460
2018-02-22 03:36:40 +03:00
levlam
d23f21abb0 Move fix_text_message implementation to MessageEntity.cpp.
GitOrigin-RevId: 24e1a7d780f5cbef62f6b2df9b4df042ab89feea
2018-02-20 05:41:17 +03:00
levlam
143ff2364f Update list of TLDs.
GitOrigin-RevId: eaa4ce74e50836bfe9204f90cd6dd316de10183a
2018-02-17 01:29:13 +03:00
levlam
2cd12d5049 Add source to get_message_entities.
GitOrigin-RevId: af699950241416adb082a08a8f6c4e106f0fb24d
2018-02-11 19:43:58 +03:00
levlam
35d039f42f Add some debug logginh.
GitOrigin-RevId: 462cf5c2f80f708ae2494b037538241f31d08ca3
2018-02-03 18:41:10 +03:00
levlam
d5d78dd1d3 Skip unallowed text entities instead of failing request.
GitOrigin-RevId: d5e22ac01e9d03bf62ebfbbb83a681f48b26b30d
2018-01-31 15:01:53 +03:00
levlam
d7ecc96113 Update layer to 75. Support entities in captions.
GitOrigin-RevId: a633d5d57c52794da0fc1b6de04f4ff1a4ed00fd
2018-01-30 20:06:54 +03:00
levlam
dc274ea3b5 Send update with an empty User for unknown users.
GitOrigin-RevId: 470184a7277bbce3855ecad8acf955369370ff76
2018-01-26 22:53:20 +03:00
levlam
2702806a89 Trim backticks in the end of URL.
GitOrigin-RevId: bcb9d7e60044f940de940b7eac4cd3279966cc47
2018-01-15 17:11:27 +03:00
levlam
5cbda834bd Update copyright year.
GitOrigin-RevId: 1369d3af1195221f6ddb9462d5f8b74fb5fef20f
2018-01-02 16:45:09 +03:00
Arseny Smirnov
71d03f39c3 Project import generated by Copybara.
GitOrigin-RevId: 318483224ad6164d9966f731d60cde37039bb2d4
2017-12-31 23:08:40 +03:00