Commit Graph

636 Commits

Author SHA1 Message Date
Arseny Smirnov
52abb9c5d5 DownloadManager create unique callback for each download 2022-03-01 15:34:51 +01:00
levlam
1f300c50e0 DownloadManager fixes. 2022-02-28 18:25:07 +03:00
Arseny Smirnov
08675f2df1 FileManager: support limit={KEEP,IGNORE}_DOWNLOAD_LIMIT in download method 2022-02-28 13:15:00 +01:00
levlam
a3cef00551 DownloadManager fixes and improvements. 2022-02-27 18:23:06 +03:00
Arseny Smirnov
f13598ec83 DownloadManager: WIP 2022-02-26 19:56:43 +01:00
Arseny Smirnov
d4a4f5fb5d Proxy some updates about file to DownloadManger. 2022-02-25 23:17:30 +01:00
levlam
0fb84181ec Add mkv to the list of allowed video extensions. 2022-02-17 15:14:49 +03:00
levlam
f5d8e4de83 Use table_remove_if. 2022-02-10 12:23:52 +03:00
levlam
2b1314295d Check and fix half of FlatHashMap usages. 2022-02-10 00:59:52 +03:00
levlam
bcc2adeb47 Fix includes and formatting. 2022-02-08 00:04:34 +03:00
Arseny Smirnov
86bceb2972 td: replace most of std::unordered_map usages to td::FlatHashMap 2022-02-07 21:21:31 +01:00
levlam
02b99d0fbf Remove includes of SequenceDispatcher.h from headers. 2022-02-01 19:34:14 +03:00
Arseny Smirnov
ad38f712e8 SequenceDispatcher: hide usage into NetQueryDispatcher 2022-02-01 18:51:36 +03:00
levlam
b1b945e239 Minor fixes. 2022-01-31 15:56:44 +03:00
levlam
8085779cdc Update copyright year. 2022-01-01 03:35:39 +03:00
levlam
5801d6c695 Improve FileGcParameters field names. 2021-12-11 23:03:11 +03:00
levlam
340e0f0b85 Fix has/have spelling. 2021-12-02 14:15:37 +03:00
levlam
a6c0902ad7 Silence g++ warnings. 2021-12-01 16:01:27 +03:00
levlam
e52508bdc1 Add source to PhotoSizeSource::get_type. 2021-11-14 10:47:02 +03:00
levlam
b731414d42 Init some fields just in case. 2021-11-11 17:39:09 +03:00
levlam
00a349656d Unify td/telegram/include order. 2021-10-27 17:32:09 +03:00
levlam
6f34c5c6a1 Make PhotoSizeSource constructors named. 2021-10-27 16:52:22 +03:00
levlam
318b782c25 Fix may_reload_photo. 2021-10-28 12:57:26 +03:00
levlam
c0fb888c42 Fix GCC 4.9 compilation errors. 2021-10-24 02:09:36 +03:00
levlam
c24501f2d9 Reduce "this" usages. 2021-10-23 21:17:00 +03:00
levlam
9f44816a62 Minor improvements. 2021-10-21 12:51:16 +03:00
levlam
1e49f6dc13 Use auto as variable type if it is initialized with a cast. 2021-10-20 01:27:02 +03:00
levlam
db7aa28bdf A lot more minor improvements. 2021-10-19 18:11:16 +03:00
levlam
81b38d5607 Mark move constructors/assignment operators noexcept. 2021-10-18 14:36:15 +03:00
levlam
f35afe23c8 Minor warning fixes. 2021-10-18 12:57:13 +03:00
levlam
b1d61383ef Remove some logging for files. 2021-10-12 11:15:25 +03:00
levlam
4bfc3eb945 Remove logging of FileDb operations. 2021-10-12 10:52:37 +03:00
levlam
328c5b57d2 Add Global::request_aborted_error. 2021-10-07 16:36:21 +03:00
levlam
3b794126d8 Avoid G usage in lambda promises. 2021-10-07 15:28:52 +03:00
levlam
b34cfef4d0 Replace begin_transaction with begin_read_transaction and begin_write_transaction. 2021-10-07 13:18:00 +03:00
levlam
c5a2e9a870 Load only chats with known info in MessagesManager::load_dialogs. 2021-09-26 19:38:27 +03:00
levlam
d882e222a7 Make FileStats fields private. 2021-09-26 12:44:18 +03:00
levlam
db18baa503 Unify include order. 2021-09-19 00:47:05 +03:00
levlam
6801eabb8d Add some FileView emptiness checks. 2021-09-16 16:58:30 +03:00
levlam
088c3169d4 Minor. 2021-09-10 18:23:23 +03:00
levlam
86de43a048 Remove useless #include comments. 2021-09-03 23:21:44 +03:00
levlam
b1eb6db7b5 Minor logging improvements. 2021-08-26 21:44:29 +03:00
levlam
209dd8b41b Don't drop fully uploaded partial secure location. 2021-08-26 21:20:55 +03:00
levlam
897a4e26a7 Allow RemoteFileLocation logging. 2021-08-26 20:34:51 +03:00
levlam
5b4a657228 Minor include fixes. 2021-08-05 01:09:39 +03:00
levlam
c2028aed4f Add limit on maximum videoNote size. 2021-07-29 23:39:07 +03:00
levlam
07630feb8c Add td_api::getSuggestedFileName. 2021-07-24 07:19:22 +03:00
levlam
8e750b867c Simplify PSLICE usage in FileLoaderUtils. 2021-07-23 20:56:44 +03:00
levlam
85fab586ef Increase file size for reuse_uploaded_photos_by_hash just in case. 2021-07-21 03:26:47 +03:00
levlam
2a9f83cd94 Don't dup URL file identifiers. 2021-07-21 03:16:55 +03:00
levlam
2641ffed31 Improve logging in FileManager. 2021-07-20 18:49:29 +03:00
levlam
40c5d47717 Make inherited classes final if possible. 2021-07-04 05:58:54 +03:00
levlam
edfa5d1d98 Use final instead of override. 2021-07-03 23:51:36 +03:00
levlam
50a8e66965 Improve error messages. 2021-06-26 04:20:59 +03:00
levlam
eb134b02f2 Improve error messages. 2021-06-25 21:21:17 +03:00
levlam
8db4febd4c Minor improvements. 2021-06-02 15:43:56 +03:00
levlam
9cecc116f3 Prefer US spelling of "canceled". 2021-05-31 21:51:48 +03:00
levlam
4bb76a7b6f Update layer to 128. Remove photo volume_id/local_id. 2021-04-16 17:43:51 +03:00
levlam
a6a4eb6616 Don't include SliceBuilder.h in logging.h. 2021-05-17 15:21:11 +03:00
levlam
17a1015f6b Remove dependency of PSLICE/PSTRING on Logger, move them to separate header and make them always safe. 2021-05-17 03:24:54 +03:00
levlam
75e593fd51 Return errors with code 400 from FileManager::from_persistent_id. 2021-04-29 16:04:04 +03:00
levlam
0339921102 Improve some spelling. 2021-03-15 03:32:14 +03:00
levlam
67889cdcbc Add td_api::getGroupCallStreamSegment. 2021-03-10 22:50:14 +03:00
levlam
e031a2c6c1 Improve Slice::truncate usage. 2021-02-04 15:54:12 +03:00
levlam
ef59e47807 Fix uploadImportedMedia. 2021-01-26 02:55:48 +03:00
levlam
15fe7f7a04 Rename suggested_name to suggested_path. 2021-01-26 02:39:48 +03:00
levlam
bff723436a Upload inported messages as small files. 2021-01-22 18:13:38 +03:00
levlam
6f38576467 Add FileManager::guess_file_type. 2021-01-22 15:17:56 +03:00
levlam
82f0386e73 Move some functions from misc.h to algorithm.h. 2021-01-01 16:01:03 +03:00
levlam
52c1da0a70 Update copyright year. 2021-01-01 15:57:46 +03:00
levlam
192fd4862f Use td::unique. 2020-12-30 18:50:57 +03:00
levlam
3f33d15879 Always adjust part size to keep low number of parts in downloaded files. 2020-11-17 02:59:58 +03:00
levlam
52a47b5f70 Add small margin for the maximum number of file parts on download. 2020-11-17 01:19:27 +03:00
levlam
5719636fa2 Add temporary reuse_uploaded_photos_by_hash option.
GitOrigin-RevId: 99fc8dae067322c51ad489f50d60979f62fa4213
2020-10-30 16:01:43 +03:00
levlam
9558b06021 Add location horizontal accuracy support.
GitOrigin-RevId: bafb7f7ff115eeede17be4bb1610045b5e3e78c9
2020-10-17 22:47:47 +03:00
levlam
6f71dca6e6 Remove some explicit td::.
GitOrigin-RevId: 93e5f0e98900a9a3b68f35e9123b2b40942879d3
2020-10-08 18:44:34 +03:00
levlam
fdc3920572 Fix some includes.
GitOrigin-RevId: 4b57613cc6e948ceb7d63b4378bc9124271e0f53
2020-10-08 18:30:36 +03:00
levlam
8a607933a7 Rename "files" log tag to "file_loader".
GitOrigin-RevId: 24fca707a99eeb32adabcca46131123d584f2c1d
2020-10-05 22:08:24 +03:00
levlam
d2d0cb5cc0 Move log tags definitions out of logging.cpp.
GitOrigin-RevId: 0e74b94ec194f8ee678bb77a04d35df46702b330
2020-10-05 18:07:23 +03:00
levlam
1fe397e43d Make optionValueInteger value int64.
GitOrigin-RevId: 7da1c4f051691ff7df31627115a9a37e6c5d5802
2020-09-25 00:46:16 +03:00
levlam
90ee4bd63c Minor fixes.
GitOrigin-RevId: ef4e2cfe4f198caec26daf04423eb26afedde5bb
2020-09-24 19:15:42 +03:00
levlam
cb3f390a92 Unify "log event" spelling.
GitOrigin-RevId: a1a491981596c56dbf7541d80ead1ea9f5d5bd04
2020-09-22 02:15:09 +03:00
levlam
25accb2d4d Silence expected warning.
GitOrigin-RevId: 82f914b98914abfdecc2aa7d4dfc55ea6ef0d0ed
2020-09-14 19:06:51 +03:00
levlam
6d23ea4aa9 Do not change download order after file merge.
GitOrigin-RevId: cb1327b7b78cd42cd873040acca328ed00dddb2b
2020-09-11 18:57:49 +03:00
levlam
51f8ed3526 Fix FileLoader closing.
GitOrigin-RevId: 85ee2acb100e160fd13752ef8fb238dcd63e1f35
2020-09-03 00:16:49 +03:00
levlam
b8419b7832 Wait DelayDispatcher closing before FileLoader closing.
GitOrigin-RevId: c2e4762be2512b1b4ed17b915c6ed2ef480bfdf4
2020-08-27 00:52:01 +03:00
levlam
e04232559a Add debug for queries sent to DelayDispatcher.
GitOrigin-RevId: 939fe59213774ba7cc91b00a86e614c29b189533
2020-08-26 12:41:15 +03:00
levlam
0e327efc7c Do not cancel already cancelled download/upload queries.
GitOrigin-RevId: 7a601fa4370a9afd6f81271abfb63edab4f31394
2020-08-26 12:33:48 +03:00
levlam
3b4d55233c Improve protected parts calculation.
GitOrigin-RevId: f066b0680a11b6c376eead756f9d67880eb6d17e
2020-08-26 12:24:06 +03:00
levlam
093ba9c9d4 Change offset and limit simultaneously.
GitOrigin-RevId: eb07ec70a9048c4b5a5a5e0f1e17431b8528e6de
2020-08-25 18:58:37 +03:00
levlam
3cc97684ec Fix tdweb build.
GitOrigin-RevId: 3609f3fa52030a242d0587d2ca6f584417af247b
2020-08-25 16:32:22 +03:00
Arseny Smirnov
51ff6105cb FileLoader: fix queries cancelling
GitOrigin-RevId: 8350a262e0c51563e987e66e77ba1922bb2f5a4d
2020-08-21 16:32:31 +03:00
Arseny Smirnov
e3fa28d457 PartsManager: fix wrong FILE_DOWLOAD_LIMIT error
GitOrigin-RevId: 89a22ae3a494c66dcb0a19abf0cd243e3ffc1875
2020-08-21 15:54:18 +03:00
Arseny Smirnov
4f41cfcbff FileLoader: smarter cancelling of queries when offset changes
GitOrigin-RevId: 2131d416eda29d93d85e8d655964c0a92cdfaf57
2020-08-21 15:53:11 +03:00
Arseny Smirnov
3b18309e80 FileManager: attempt to close ForceUpoadActor
GitOrigin-RevId: 5c53784b7b49c41347477c2f7808cc2845d12463
2020-08-13 20:04:06 +03:00
levlam
ceb49d0143 Simplify parser.start_with usage.
GitOrigin-RevId: 465e51bba514259ebe15976d2612e1a46754a841
2020-07-21 14:24:55 +03:00
levlam
405934676e Change file_id type in as_profile_photo.
GitOrigin-RevId: fe45d895b4781c942512d5c838d99449431440d3
2020-07-20 17:46:54 +03:00
levlam
e16952121b Use emplace whenever possible.
GitOrigin-RevId: 67cd8e3b6331c5e1671a9d662f034af1e29d3ac6
2020-07-13 23:20:16 +03:00
levlam
82fdcd279c Drop outdated full Chat/Channel photo.
GitOrigin-RevId: 047da02c13e0de58a5fd3ca4a94e3b23485ec548
2020-07-06 18:40:58 +03:00
levlam
040ce6c529 Move get_persistent_id to FileView.
GitOrigin-RevId: e56d5998c515c5d5e93d31f8922a677f08a17243
2020-07-06 18:31:26 +03:00
levlam
53d694a01c Fix get_actor_unsafe usages.
GitOrigin-RevId: f39aa2d0a2083842698337bb34457826c1951be6
2020-07-04 12:00:14 +03:00
levlam
2ac8c164ff Increase maximum file size.
GitOrigin-RevId: d4da965e7ecea03bc3eb356c41a81a715a06ace0
2020-07-03 17:31:06 +03:00
levlam
5507d58339 Better handling of secondary file types in scan_fs.
GitOrigin-RevId: 7602a2e14c39fb280be03053160e2ad922ea1ca4
2020-06-28 22:04:21 +03:00
levlam
c5cba87bf6 Improve user photo registration.
GitOrigin-RevId: 323513d5a30710bb8aabde9476b09be2eb8bd059
2020-06-27 21:59:10 +03:00
levlam
eb79c3084e Silence FILE_DOWNLOAD_ID_INVALID error logging.
GitOrigin-RevId: e332bc61d58f536a57ce4a10a7da0f6779fa5184
2020-06-27 19:48:08 +03:00
levlam
8872fbf6ac Fix tdutils after merge.
GitOrigin-RevId: 5b9a863e405a9e3782157570156fda71bf2bb589
2020-06-26 02:24:13 +03:00
Arseny Smirnov
fd6423dedf update tdutils from another project
GitOrigin-RevId: 79b8eb2ba229d733f82dbb17b8bd7f27471c9472
2020-06-24 14:47:36 +03:00
levlam
d01c906f53 Add get_main_file_type.
GitOrigin-RevId: 138fc28f8c8e59a8583514b53ce37750f2f0360a
2020-06-22 08:43:00 +03:00
levlam
9334243a5d Unify conversion function names.
GitOrigin-RevId: 10def5544dfd6a94ff89b15441006d102b512439
2020-06-22 04:28:03 +03:00
levlam
32af19acfe Improve constant name.
GitOrigin-RevId: 650c2c1ef42bb4d31f4cd5094cca5d251cc6c28a
2020-06-22 02:27:58 +03:00
levlam
d75c6eff57 Add FileType.cpp.
GitOrigin-RevId: 8ed89c8f90d3d83d810bdaede43d839962fea6fe
2020-06-22 02:20:48 +03:00
levlam
d5b4c57993 Add inputMessageDocument.force_file.
GitOrigin-RevId: 7f2780ba7f333e5f8df9c28bab429b8b12eaf26c
2020-06-22 02:02:21 +03:00
levlam
2ed9cb3b75 Minor fixes.
GitOrigin-RevId: ce9058c2075281697cc41de2ab970dd11e189f77
2020-06-13 05:13:11 +03:00
Arseny Smirnov
541f15bd68 files: better debug message in 'Cycle in database' error
GitOrigin-RevId: 8817236d9a4a628468663c68f48f8990a2317f96
2020-06-09 17:04:47 +03:00
levlam
9c5c112733 Fix max file size checks.
GitOrigin-RevId: 04695d57d2e32db680308a45ca7adad2f87ebe11
2020-06-03 21:22:58 +03:00
levlam
6172ece619 Do not check size exceeding of downloaded file.
GitOrigin-RevId: e7a7ca59867328737fe63db6aa60398229bd85a1
2020-06-01 21:35:06 +03:00
levlam
280d6f6649 Fail download in case of error in on_download_ok.
GitOrigin-RevId: 20ab3d279d54c945bfe4d114e9980ff8b636f292
2020-06-01 20:48:18 +03:00
levlam
d5c6c51f15 First check existence of generate location in run_generate.
GitOrigin-RevId: e4a9ac3a7cef153bde854a058bcd81a371d58dd7
2020-05-24 21:35:47 +03:00
levlam
f2cb3afaef Increase maximum photo size for upload by hash.
GitOrigin-RevId: b7dbcaf4710d04b03fc8eaf1d0c1c51ad5224829
2020-05-07 18:37:49 +03:00
levlam
99ffc0c5da Add logging.
GitOrigin-RevId: 4e039d5973121b82dcf118ba34a6a5835b6f7502
2020-05-04 03:01:01 +03:00
levlam
c8f56c62d8 Do not try to reuse file_id without remote location.
GitOrigin-RevId: 2dd994de062d1f640982923e4a7970fd7bbda583
2020-05-04 16:01:35 +03:00
levlam
3175ed4c0a Minor fixes.
GitOrigin-RevId: e10945b585d067da0b6a532b9d9210aade7673d4
2020-04-30 22:21:42 +03:00
levlam
d26cf8f8a3 Add temporary "upload by hash" for photos.
GitOrigin-RevId: f2fca54bce80d3eb9a84a7f4f6326e98633417a5
2020-04-24 00:50:14 +03:00
levlam
8681b76de2 Minor fixes.
GitOrigin-RevId: b75bac1586ed36b91b7c2ab64c386f94f18d8539
2020-04-21 03:29:20 +03:00
levlam
87afb93b93 Fix some ID spelling.
GitOrigin-RevId: cdd8cdb93696c690cf7bdb9b2df175bb926a7510
2020-04-19 13:45:37 +03:00
levlam
cd7a9d7b3a Fix updating of last_successful_force_reupload_time_.
GitOrigin-RevId: c213f39ba0bb75d541f8c007cebb4dfa81de03fc
2020-04-11 03:56:19 +03:00
levlam
ba5e5f0ece Allow to reupload file again after successful merge.
GitOrigin-RevId: 46bc9d002f804fe6c39e1ba8844740141e0a6f9f
2020-04-10 03:43:35 +03:00
levlam
00a70b466d Do not add file source from self-destructing messages.
GitOrigin-RevId: 5ac703d188ec532a52efa8549ee8c7e63a78a78b
2020-04-09 18:43:27 +03:00
Arseny Smirnov
5c0be2f24f FileManager: trying to cancel upload/download in run_{upload,download} before any other checks
GitOrigin-RevId: 3df57338d0a0fcec3fb04a11ff21b090909c9c83
2020-04-09 12:53:00 +03:00
levlam
29c81b4252 Warn on DcId change only for server locations.
GitOrigin-RevId: 04f11a63d84882f7c1ccd15a79845b7482c6a451
2020-03-31 02:16:23 +03:00
levlam
05253ca35e Add td_api::setStickerSetThumbnail.
GitOrigin-RevId: 1083c307cf89744c4dcfa16f89eaec1d2660309f
2020-03-20 16:36:07 +03:00
levlam
c4023a3f9b Use KB instead of kB for 1024 bytes.
GitOrigin-RevId: 163ebf3f28f5e6f6710b3ff85bdfc21996c67acb
2020-03-20 03:20:07 +03:00
levlam
d06a786a16 Simplify NetQueryCreator and remove mtproto dependency on telegram_api.
GitOrigin-RevId: 2edfc9d6d80eab8716dfd3722f6aebe53dba1e47
2020-03-16 01:01:14 +03:00
levlam
b8848a2ab4 Simplify NetQuery creation.
GitOrigin-RevId: a01e72f8e196b405dd28dfd75d16cadc7127ec4a
2020-03-16 00:17:11 +03:00
levlam
8d01251f8b Add NetQueryCreator::create_unauth.
GitOrigin-RevId: 79043a3662b0353f000f388b3ee2763abf49fe2d
2020-03-15 04:51:14 +03:00
levlam
c4c9e51157 Make all fields required in full NetQueryCreator methos.
GitOrigin-RevId: aa8ebb5cc46b9f3b7c0b606c012ace5fafe2bbf2
2020-03-15 04:15:54 +03:00
levlam
ad3c28932b Remove manual Gzip flag specification in query creation; support uploaded files pack.
GitOrigin-RevId: 46ddfc230182615517eac7b611a79284559bd694
2020-03-15 02:49:10 +03:00
levlam
f752f3fade Fix warning.
GitOrigin-RevId: e36b575836941252e7c91d6fcf9498d80af9977b
2020-03-03 16:21:46 +03:00
levlam
a1e93ebba5 Add optimizeStorage.return_deleted_file_statistics.
GitOrigin-RevId: f7533781027891624017c605b1d3ac3e91da5086
2020-03-02 11:59:47 +03:00
levlam
bd0621eeff Optimize adding new files to FileStats.
GitOrigin-RevId: bceb6a4540f45339fed92c1a83b19d1981634836
2020-03-02 02:55:08 +03:00
levlam
0b30530260 Minor file GC improvements.
GitOrigin-RevId: a14b6e219ad90537875108b3e42473bf33267855
2020-03-02 02:41:47 +03:00
levlam
9862652e14 Use the exact file size instead of the real file size in fast storage statistics on Windows, because the real file size is smaller then expected before the file is synced.
GitOrigin-RevId: 451231c899c1b6c6b80b46e2cb42bd3b94def0a5
2020-02-19 17:57:30 +03:00
levlam
e60cf58d68 Reget profile photo on LOCATION_INVALID.
GitOrigin-RevId: ca1b929d21537a403d1893bcb79c1a7a61694ad7
2020-01-27 14:39:19 +03:00
levlam
b9d1b80f6a Do not remove file reference from remote.id.
GitOrigin-RevId: 3c934cec452f4ca4147aa81711fcd0ac1fee964a
2020-01-16 05:09:25 +03:00
levlam
06eb99d4d0 Return back correct file_id version.
GitOrigin-RevId: 53572782a4f54512022ce8e065e546a850951302
2020-01-16 04:56:45 +03:00
levlam
cf019bb59c Clear invalid file references loaded from database.
GitOrigin-RevId: 12d060ea93146f62190d9fa97421a7931cf29b8d
2020-01-16 04:52:36 +03:00
levlam
89d7374272 Temporarily disable CDN if streaming is enabled.
GitOrigin-RevId: e6479f76a1a226d27268744421a904b4849edf17
2020-01-08 20:15:49 +03:00
levlam
a06f02b747 Fix misprint.
GitOrigin-RevId: e7bcfcd2ada1b78906d5e5f9228e920be2a00a8c
2020-01-06 18:02:42 +03:00
levlam
b88730f635 Better logging.
GitOrigin-RevId: d5aa21fee3d0f9af6fdec13df45c7352850b8b86
2020-01-06 17:54:16 +03:00
levlam
c8bf8fa5f7 Use real allocated file size in storage statistics.
GitOrigin-RevId: 6e5232700d8e97ba3ce0838c3bf7764541b6fd2a
2020-01-03 04:08:22 +03:00