Commit Graph

82 Commits (d57d5962f4707189758a3b17ed47c77e019fc77c)

Author SHA1 Message Date
ansuz 0cb3a13aca lint compliance
ansuz b59969f48b archive channels at expiration time if configured to prefer archiving
ansuz d19b704bb8 fix an inverted boolean
ansuz 1e5248ff9d implement methods for checking if a file exists in the database or the archive
ansuz 58cee9e13d remove an XXX because the code looks safe
ansuz 6aa6b706a4 don't release until you think about this XXX a bit more
ansuz ddf4a6a784 pass the correct path to 'listChannels' for 'listArchivedChannels'
ansuz 7e455e6fce drop unnecessary code, restore instead of remove archived files in restoration script, change restore archived name
ansuz cb0c4ee944 don't continue iterating in listChannels until a the current task has called back
ansuz c0d908af4d implement 'unarchiveChannel'
ansuz 11976b262e add a note for later
ansuz dd375a2a22 every type of storage should have its own nested directory within the archive
ansuz 7647f7c68a implement four new storage APIs
* listChannels
* listArchivedChannels
* archiveChannel
* removeArchivedChannel
ansuz aa9a27634a actual lint compliance
ansuz ec64de2c67 additional work on the storage API
* optimize layout on the filesystem
* drop some unused functions
* don't recurse over folders that you know won't be relevant
* remove empty folders
* add a migration API
* fix some minor bugs with asynchrony
* lint compliance
ansuz 7b55df5931 rewrite task execution as API instead of a script
ansuz 253545636b add a note to fix some weird behaviour in storage/file
ansuz e1e6d51038 new logging api
ansuz fc43c08baf un-break all the imports in tasks.js
ansuz 51fae45cce add notes re: logging and cold storage
ansuz 0a1971cfee improved support for nested data directories
ansuz 1600f800e8 add a todo for flat file db atime
yflory ef0c08130d Stop the process when expire-channels is done
ansuz 8e2c9ebfa3 lint compliance or something
ansuz b4b51ed86a add a subsystem for scheduling tasks
ansuz a5b7b0191f correct validation for 'channelName'
Caleb James DeLisle b63d1527a0 Small bit of better logging
Caleb James DeLisle 014aacc76a Added a new RPC to get file offsets of messages by hash or of last 2 checkpoints, also improved checking of valid channel names and fixed a pull-stream bug and exposed async-store to the window
Caleb James DeLisle b3a873bbc9 Fix flow
Caleb James DeLisle 88f3e730b9 Update package.json and sync file.js
Caleb James DeLisle f3167964f4 In case there is an error parsing one of the messages in a file, catch rather than blowing up
Caleb James DeLisle edeb1e25d3 Bad solution to a bad problem
yflory cd7c5abc3e Fix a missing callback in closeChannel
ansuz b295aaa6c7 harden clearChannel implementation
ansuz a756faf818 lint compliance
ansuz eeb2ee2d17 add clear channel rpc
ansuz 78b11584f8 remove unused variables
Caleb James DeLisle 211113fb1a little flowey
ansuz d0466a2052 implement 'getChannelSize' api in storage
ansuz 78f8286fe3 add a note about installing storage adaptors from npm
ansuz 1f2e45d6c8 improved fs storage adaptor and config docs
* regularly close open file descriptors older than channelExpirationMs
* clean up older file descriptors when exceeding openFileLimit
ansuz 4b238de84c quieter stdout and stderr logs
Caleb James DeLisle 038a986e83 Fix path for file storage on windows
ansuz fc7576fe20 implement channel removal
ansuz 38d1a1a291 faster message iteration
ansuz b46f74cd78 remove alternative storage adaptors from core
ansuz 19caac232b don't try to send invalid messages
Caleb James DeLisle de9f642ccc typo
Caleb James DeLisle 5fe3ffabd1 stop using waitFor.abort() which is apparently not implemented
Caleb James DeLisle 2021bf6702 Improvements to the file storage format