Commit Graph

102 Commits (bb0365622b9c776974098b33308b1ef24e47d051)

Author SHA1 Message Date
ansuz b59f03b949 consider changes to metadata logs as channel activity 2019-08-30 14:30:17 +02:00
ansuz d6fc35cab4 mkdirp the path to metadata before writing 2019-08-26 17:44:21 +02:00
ansuz b82c0a420a merge latest staging 2019-08-22 18:01:20 +02:00
ansuz 84e1057153 address remaining notes in the storage api 2019-08-22 17:48:28 +02:00
ansuz a63bea1f59 remove invalid callback which would totally break channelBytes 2019-08-22 11:50:06 +02:00
ansuz 3c1aadd6c1 archive metadata even if there is no corresponding channel log 2019-08-22 11:49:43 +02:00
ansuz a3a7bcbe35 add comments for lots of functions 2019-08-21 12:15:27 +02:00
ansuz d6d7f4f601 include the size of the metadata log in the computed size of a channel 2019-08-21 12:14:49 +02:00
ansuz 2aebadcff3 use the correct path for channel data when restoring logs from the archive 2019-08-21 12:13:39 +02:00
ansuz 1c89e8d6ac A few updates for editable metadata
* add and update many comments
* correctly handle metadata for young channels and range requests
* add a simple implementation of 'writeMetadata'
2019-08-14 14:37:54 +02:00
ansuz 206de52ee8 call back from writeMetadata 2019-08-12 15:25:37 +02:00
ansuz bf058d8042 prevent multiple callbacks when reading dedicated metadata 2019-07-23 13:56:37 +02:00
ansuz b36f50f2c9 update metadata queries to include edits 2019-06-27 18:21:12 +02:00
ansuz b128b7f02c updated methods for working with editable metadata 2019-06-26 17:55:36 +02:00
ansuz fd43da2dbf archive and restore metadata logs and channel logs together 2019-06-25 16:38:29 +02:00
ansuz a16d7171ad add some more notes 2019-06-25 16:31:21 +02:00
ansuz 0668abf68c correct the regular expression for iterating over channels 2019-06-25 15:42:10 +02:00
ansuz fc9aaf0ecb remove unnecessary argument from channelExists
also add some notes
2019-06-25 15:41:20 +02:00
ansuz 3513e437b6 update atime when accessing files 2019-06-25 15:38:56 +02:00
ansuz 46cd796db5 label code that will need to change for editable metadata 2019-06-25 13:43:15 +02:00
ansuz 0cb3a13aca lint compliance 2019-06-19 12:10:14 +02:00
ansuz b59969f48b archive channels at expiration time if configured to prefer archiving 2019-06-19 11:52:20 +02:00
ansuz d19b704bb8 fix an inverted boolean 2019-06-14 13:38:09 +02:00
ansuz 1e5248ff9d implement methods for checking if a file exists in the database or the archive 2019-06-14 11:38:16 +02:00
ansuz 58cee9e13d remove an XXX because the code looks safe 2019-06-13 16:48:12 +02:00
ansuz 6aa6b706a4 don't release until you think about this XXX a bit more 2019-06-13 16:36:22 +02:00
ansuz ddf4a6a784 pass the correct path to 'listChannels' for 'listArchivedChannels' 2019-06-13 12:16:23 +02:00
ansuz 7e455e6fce drop unnecessary code, restore instead of remove archived files in restoration script, change restore archived name 2019-06-13 12:16:23 +02:00
ansuz cb0c4ee944 don't continue iterating in listChannels until a the current task has called back 2019-06-13 12:16:23 +02:00
ansuz c0d908af4d implement 'unarchiveChannel' 2019-06-13 12:16:23 +02:00
ansuz 11976b262e add a note for later 2019-06-13 12:16:23 +02:00
ansuz dd375a2a22 every type of storage should have its own nested directory within the archive 2019-06-13 12:16:23 +02:00
ansuz 7647f7c68a implement four new storage APIs
* listChannels
* listArchivedChannels
* archiveChannel
* removeArchivedChannel
2019-06-13 12:16:23 +02:00
ansuz aa9a27634a actual lint compliance 2019-04-23 17:29:39 +02:00
ansuz ec64de2c67 additional work on the storage API
* optimize layout on the filesystem
* drop some unused functions
* don't recurse over folders that you know won't be relevant
* remove empty folders
* add a migration API
* fix some minor bugs with asynchrony
* lint compliance
2019-04-23 17:20:03 +02:00
ansuz 7b55df5931 rewrite task execution as API instead of a script 2019-04-23 13:26:45 +02:00
ansuz 253545636b add a note to fix some weird behaviour in storage/file 2019-04-08 18:18:48 +02:00
ansuz e1e6d51038 new logging api 2019-04-08 18:11:36 +02:00
ansuz fc43c08baf un-break all the imports in tasks.js 2019-03-29 16:55:45 +01:00
ansuz 51fae45cce add notes re: logging and cold storage 2019-03-29 14:57:53 +01:00
ansuz 0a1971cfee improved support for nested data directories 2019-03-29 14:40:44 +01:00
ansuz 1600f800e8 add a todo for flat file db atime 2019-01-28 14:21:17 +01:00
yflory ef0c08130d Stop the process when expire-channels is done 2018-02-15 11:33:31 +01:00
ansuz 8e2c9ebfa3 lint compliance or something 2018-01-29 14:26:24 +01:00
ansuz b4b51ed86a add a subsystem for scheduling tasks 2018-01-26 15:24:07 +01:00
ansuz a5b7b0191f correct validation for 'channelName' 2018-01-24 11:31:34 +01:00
Caleb James DeLisle b63d1527a0 Small bit of better logging 2018-01-23 18:54:52 +01:00
Caleb James DeLisle 014aacc76a Added a new RPC to get file offsets of messages by hash or of last 2 checkpoints, also improved checking of valid channel names and fixed a pull-stream bug and exposed async-store to the window 2018-01-23 16:31:59 +01:00
Caleb James DeLisle b3a873bbc9 Fix flow 2018-01-23 14:15:38 +01:00
Caleb James DeLisle 88f3e730b9 Update package.json and sync file.js 2018-01-23 12:18:08 +01:00