Commit Graph
57 Commits
Author SHA1 Message Date
Artyom SavchenkoandGitHub cfa72c2dac Limit files upload (#10878)
* Limit files upload

Signed-off-by: Artem Savchenko <armisav@gmail.com>

* Max size limit

Signed-off-by: Artem Savchenko <armisav@gmail.com>

* Add storage usage and adjust styles

Signed-off-by: Artem Savchenko <armisav@gmail.com>

* Use mb for file size limit

Signed-off-by: Artem Savchenko <armisav@gmail.com>

---------

Signed-off-by: Artem Savchenko <armisav@gmail.com>
2026-06-16 15:20:48 +07:00
Alexander OnnikovandGitHub 9407f8463f fix: prevent datalake from error flood (#10521)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2026-02-18 12:54:39 +07:00
Alexander OnnikovandGitHub 7b133e084d fix: secure blobs (#10490)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2026-02-09 09:22:27 +07:00
Alexander OnnikovandGitHub c06ded12e2 fix: embed pdf via direct link (#10491)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2026-02-07 17:33:51 +05:00
c8aec52f13 Postgress support (#10331)
* Pure PostgreSQL

Signed-off-by: Andrey Sobolev <haiodo@gmail.com>

* Fix formatting

* Optimize a tests

+ Optimize a stream docker build

* Fix migrations

Signed-off-by: Artem Savchenko <armisav@gmail.com>

* Fix datalake image

Signed-off-by: Artem Savchenko <armisav@gmail.com>

* Fix formatting

Signed-off-by: Artem Savchenko <armisav@gmail.com>

---------

Signed-off-by: Andrey Sobolev <haiodo@gmail.com>
Signed-off-by: Artem Savchenko <armisav@gmail.com>
Co-authored-by: Andrey Sobolev <haiodo@gmail.com>
2025-12-26 12:11:38 +07:00
Alexander OnnikovandGitHub 84cbd4e12a remove image endpoint from datalake (#10112)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-10-20 11:04:49 +07:00
Andrey SobolevandGitHub aa7829bb93 Update deps oct 11 (#10069)
Signed-off-by: Andrey Sobolev <haiodo@gmail.com>
2025-10-12 08:55:50 +07:00
Alexander OnnikovandGitHub 58adc36a5a qfix: validate workspace uuid in datalake (#10048) 2025-10-08 19:10:40 +07:00
Andrey SobolevandGitHub c27ba3150f Pass meta to tx and queue (#9695)
+ Pass ctx context via platform queue
+ Fix queue contracts
+ Add meta to tx, skip store.

Signed-off-by: Andrey Sobolev <haiodo@gmail.com>
2025-08-20 12:13:43 +07:00
Alexander OnnikovandGitHub 47402753ff fix: datalake cache memory leaks (#9699)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-08-19 22:34:11 +07:00
Alexander OnnikovandGitHub ec93872608 fix: datalake upload fixes (#9680)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-08-15 15:52:39 +07:00
Alexander OnnikovandGitHub 75f2ec9882 fix: ignore existing blobs in datalake migration (#9664)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-08-12 13:19:24 +07:00
Alexander OnnikovandGitHub cb99b82465 UBERF-11664 Use LRU cache in Datalake (#9658)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-08-12 11:59:35 +07:00
Alexander OnnikovandGitHub 8d9c84b648 UBERF-11178 Migrate datalake workspace id (#9092)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-08-12 11:13:01 +07:00
Alexander OnnikovandGitHub 5129ed0f56 fix: log more stats in datalake (#9624)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-07-31 21:26:46 +07:00
Anton AlexeyevandGitHub 64530262bb Allow to get blob metadata without authorization (#9615)
Since getting the blob itself does not require authorization

Signed-off-by: Anton Alexeyev <alexeyev.anton@gmail.com>
2025-07-30 16:55:30 +07:00
Andrey SobolevandGitHub 88351f639f qfix: Rework span creation (#9613)
Signed-off-by: Andrey Sobolev <haiodo@gmail.com>
2025-07-29 23:32:16 +07:00
Andrey SobolevandGitHub 790595a26c qfix: Remove sentry on server (#9597) 2025-07-24 21:14:20 +07:00
Andrey SobolevandGitHub 8fef0d7f17 OpenTelemetry support (#9584)
Signed-off-by: Andrey Sobolev <haiodo@gmail.com>
2025-07-23 13:49:14 +07:00
Anton AlexeyevandGitHub c0d4fda896 Forbid datalake operations for readonly role (#9468)
Signed-off-by: Anton Alexeyev <alexeyev.anton@gmail.com>
2025-07-04 19:17:51 +05:00
Alexander OnnikovandGitHub 2dd87b8e85 fix: pass cache control from request to created blob (#9430)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-07-02 14:27:55 +07:00
KristinaandGitHub 2c83ddb004 Put workspace to message headers (#9428)
Signed-off-by: Kristina Fefelova <kristin.fefelova@gmail.com>
2025-07-01 23:43:39 +07:00
Alexander OnnikovandGitHub e617ffd15d UBERF-12083 Expose service from token in datalake stats (#9424) 2025-07-01 18:05:15 +07:00
Alexander OnnikovandGitHub 47f97e189a UBERF-12032 Readonly storage config (#9412)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-06-30 18:06:19 +07:00
Anton AlexeyevandGitHub e5e9b1cb92 Billing service (#9325)
Signed-off-by: Anton Alexeyev <alexeyev.anton@gmail.com>
2025-06-24 11:10:27 +07:00
Alexander OnnikovandGitHub b007009678 fix: transcode livekit videos uploaded to s3 (#9342)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-06-24 10:40:08 +07:00
Alexander OnnikovandGitHub 2a945a0613 feat: use queue for transcoding tasks (#9216)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-06-12 22:53:03 +07:00
Alexander OnnikovandGitHub c5f9aaaca9 fix: properly configure keep-alive in datalake HTTP server (#9198)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-06-10 20:27:01 +07:00
Alexander OnnikovandGitHub 852137c213 UBERF-11432 Use tx queue for blobs events (#9175)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-06-05 13:33:09 +07:00
Alexander OnnikovandGitHub 94e9d0cbf1 fix: datalake memory leak fixes (#9161)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-06-03 17:52:54 +07:00
Alexander OnnikovandGitHub 4a9a547bf7 fix: correct filename in content-disposition header (#9139)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-05-30 14:06:53 +07:00
Alexander OnnikovandGitHub 0c8c2cc84e fix: do not report some datalake errors to analytics (#9085)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-05-25 16:33:07 +07:00
Alexander OnnikovandGitHub 10f7413efa UBERF-10528 Handle derived blobs in datalake (#8930)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-05-14 22:14:04 +07:00
Alexander OnnikovandGitHub 6c5a6aae27 Use datalake in tests and dev (#8826)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-05-05 10:44:03 +07:00
Nikolay MarchukandGitHub 0eac3cde01 Validate token access to datalake (#8812)
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
2025-05-02 23:29:33 +07:00
Nikolay MarchukandGitHub 7e710f04a9 Provide same response format for front and datalake upload (#8809)
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
2025-05-02 13:06:52 +07:00
Alexander OnnikovandGitHub 99303350c9 UBERF-10383 Ignore premature close errors in datalake (#8743)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-04-28 20:57:32 +07:00
Alexander OnnikovandGitHub 17ac05f126 UBERF-10355 Adjust image transformation parameters to increase quality (#8705)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-04-25 15:01:07 +07:00
Alexander OnnikovandGitHub 498551f4e3 expose datalake cpu and memory stats (#8561) 2025-04-15 21:05:54 +07:00
Alexander OnnikovandGitHub 5ac8c165da fix: add error reporting in datalake (#8535)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-04-11 11:27:05 +05:00
Alexander OnnikovandGitHub 88e38b12f0 UBERF-9752: properly handle streams to avoid datalake memory leak (#8502)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-04-09 13:16:55 +07:00
Alexander OnnikovandGitHub 19cb971e92 UBERF-9730 Expose server timing in datalake service (#8447)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-04-03 13:49:56 +07:00
Alexander OnnikovandGitHub 57cd51ee1d fix: handle double quotes in etag (#8362)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-03-27 13:05:25 +07:00
Denis TingaikinandGitHub 9fdb7bb7a9 Request hls video for all video content (#8313)
Signed-off-by: denis-tingaikin <denis.tingajkin@xored.com>
2025-03-22 00:17:33 +07:00
Alexander OnnikovandGitHub dac0f70631 fix: multipart upload in datalake service (#8307)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-03-21 21:25:06 +07:00
Denis TingaikinandGitHub 6d2dc73524 Add a token for stream requests (#8288) 2025-03-20 07:31:37 +07:00
Alexander OnnikovandGitHub ed60739dfd fix: use host + port in datalake address (#8276)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-03-19 16:51:25 +07:00
Alexander OnnikovandGitHub b531cf2cce UBERF-9637 Fix: prevent sharp rotating image on resize (#8256)
Signed-off-by: Alexander Onnikov <Alexander.Onnikov@xored.com>
2025-03-18 09:18:01 +07:00
Alexander OnnikovandGitHub e6acd6082b fix: datalake fixes (#8251) 2025-03-17 22:11:02 +07:00
Denis TingaikinandGitHub e092c3ae80 use huly stream instedof cf stream (#8245)
Signed-off-by: denis-tingaikin <denis.tingajkin@xored.com>
2025-03-17 17:44:37 +07:00