48deced859
fix serverside index corruption
5 years ago
5b2929a6fc
suppress some useless info from some commonly logged errors
5 years ago
9f1f01f3b4
disable worker task queueing and address a probable memory leak
5 years ago
b0af6b5488
fix an incorrect condition when checking for available server workers
...
Also, log when the RPC queue has a backlog and when it is drained
5 years ago
4037270a23
add a FIXME note for a sketchy implementation in history keeper
5 years ago
02347d134a
queue signature validation per-channel to ensure correct ordering
5 years ago
9975c27e84
increase timeout from one minute to three and decrease the number of parallel jobs per worker
5 years ago
488f876ad6
lint compliance
5 years ago
d35b015c3f
log some info on successful file uploads
5 years ago
37d3995ac1
unify format of console output with stored logs
5 years ago
8a5d012edf
add special error handling for a few special serverside errors
5 years ago
8bee95d13d
improve error reporting in GET_HISTORY
5 years ago
e05891184e
fix regression in maxWorkers
5 years ago
b56c73be6e
delegate more work from getOlderHistory to the worker
5 years ago
fd169ff39c
close streams after 2 minutes instead of 5
...
Hopefully this helps to even out our memory and CPU usage.
There's also some improved labels so that IF streams time out
we will know the exact origin of the offending call.
5 years ago
bac8ef3c6e
lint compliance
5 years ago
4e57e390da
write tasks inside of workers
5 years ago
ba6faca02e
make the number of workers configurable
5 years ago
0465f31a45
add a FIXME note
5 years ago
04ab7f538a
recover from worker faults and unify worker types
5 years ago
e0a6852b79
correctly serialize an error log
5 years ago
9ed82640bf
Merge branch 'worker-queue' into staging
5 years ago
e8b1fcf710
solve some cases where crashing workers could result in an invalid state for the queue
5 years ago
9ed26cfeb0
lint compliance
5 years ago
dc0460780f
Merge branch 'soon' into staging
5 years ago
74567e0cf4
return process memory usage in GET CACHE STATS RPC
5 years ago
e3f42cbc20
Allow config.defaultStorageLimit to be zero bytes
5 years ago
89262cd29e
resolve silly conflict and merge staging
5 years ago
e527867e2e
queue blob and channel deletions per-user
5 years ago
bd3e18d1a8
only cache a user's pinned channels if there are no errors when loading them
5 years ago
bef18a9320
hotfix
5 years ago
7fac997e93
increase some file storage timeouts related to streams
5 years ago
95965c1dee
keep a parallel implementation of the pin loader to validate the new one
5 years ago
a57bf94058
remove XXX note
5 years ago
c53675c9d5
WIP worker rpc call queue
5 years ago
d802173325
remove an invalid line
5 years ago
2b3f6e3464
Merge branch 'soon' into staging
5 years ago
adfd1eaaa2
avoid a silly typeError in the event of an error
5 years ago
32406a5995
Merge branch 'master' into staging
5 years ago
834c96a4fc
update comments and remove some notes
5 years ago
ed5d97f899
WIP history-keeper fixes
5 years ago
eddbe80eef
Merge branch 'soon' into staging
5 years ago
3d8e78a268
fix overly broad config interpretation for daily check
5 years ago
e6ec891d9a
improve admin rpc for diagnosing memory used by the cache
5 years ago
77961e3954
trim lookup tables for channels without checkpoints
5 years ago
db9eaa8d4f
Merge branch 'soon' into staging
5 years ago
6d0dee979a
allow admins to inspect index/metadata caches
5 years ago
cbd3547814
remove log statements
5 years ago
9058a59555
reassign db tasks if the responsible worker fails
5 years ago
172823c954
lint compliance
5 years ago
ansuz