dd375a2a22
every type of storage should have its own nested directory within the archive
6 years ago
7647f7c68a
implement four new storage APIs
...
* listChannels
* listArchivedChannels
* archiveChannel
* removeArchivedChannel
6 years ago
aa9a27634a
actual lint compliance
6 years ago
ec64de2c67
additional work on the storage API
...
* optimize layout on the filesystem
* drop some unused functions
* don't recurse over folders that you know won't be relevant
* remove empty folders
* add a migration API
* fix some minor bugs with asynchrony
* lint compliance
6 years ago
7b55df5931
rewrite task execution as API instead of a script
6 years ago
253545636b
add a note to fix some weird behaviour in storage/file
6 years ago
e1e6d51038
new logging api
6 years ago
fc43c08baf
un-break all the imports in tasks.js
6 years ago
51fae45cce
add notes re: logging and cold storage
6 years ago
0a1971cfee
improved support for nested data directories
6 years ago
1600f800e8
add a todo for flat file db atime
6 years ago
ef0c08130d
Stop the process when expire-channels is done
7 years ago
8e2c9ebfa3
lint compliance or something
7 years ago
b4b51ed86a
add a subsystem for scheduling tasks
7 years ago
a5b7b0191f
correct validation for 'channelName'
7 years ago
b63d1527a0
Small bit of better logging
7 years ago
014aacc76a
Added a new RPC to get file offsets of messages by hash or of last 2 checkpoints, also improved checking of valid channel names and fixed a pull-stream bug and exposed async-store to the window
7 years ago
b3a873bbc9
Fix flow
7 years ago
88f3e730b9
Update package.json and sync file.js
7 years ago
f3167964f4
In case there is an error parsing one of the messages in a file, catch rather than blowing up
7 years ago
edeb1e25d3
Bad solution to a bad problem
7 years ago
cd7c5abc3e
Fix a missing callback in closeChannel
7 years ago
b295aaa6c7
harden clearChannel implementation
7 years ago
a756faf818
lint compliance
7 years ago
eeb2ee2d17
add clear channel rpc
7 years ago
78b11584f8
remove unused variables
8 years ago
211113fb1a
little flowey
8 years ago
d0466a2052
implement 'getChannelSize' api in storage
8 years ago
78f8286fe3
add a note about installing storage adaptors from npm
8 years ago
1f2e45d6c8
improved fs storage adaptor and config docs
...
* regularly close open file descriptors older than channelExpirationMs
* clean up older file descriptors when exceeding openFileLimit
8 years ago
4b238de84c
quieter stdout and stderr logs
8 years ago
038a986e83
Fix path for file storage on windows
8 years ago
fc7576fe20
implement channel removal
8 years ago
38d1a1a291
faster message iteration
8 years ago
b46f74cd78
remove alternative storage adaptors from core
8 years ago
19caac232b
don't try to send invalid messages
8 years ago
de9f642ccc
typo
8 years ago
5fe3ffabd1
stop using waitFor.abort() which is apparently not implemented
8 years ago
2021bf6702
Improvements to the file storage format
8 years ago
4b64f00cc0
don't log when cleaning up idle channels
8 years ago
be69e2828c
implement flat file storage
8 years ago
217e664d4c
boilerplate for filesystem-backed storage
8 years ago
68b35ace38
add a SQL database adaptor
8 years ago
9c15a43268
add removeChannel documentation to storage/README
9 years ago
1b2c129380
implement channel removal in amnesiadb
9 years ago
061cffe462
transform and pass through the existing store
9 years ago
e83e5026ce
make amnesiadb compatible with netflux
9 years ago
d576fdc886
fix bug where empty channels failed
9 years ago
86bbc15017
document modified storage API
9 years ago
ce69062b7c
implement callback for getMessages
9 years ago
e68dd31a53
Fix #19 by adding a lock to level db connector
9 years ago
07fdeebe17
LogStore.js : JSHint compliance and slight reformat
9 years ago
7ee75b9e7f
Messages received by the WebSocket server are now saved in a file
9 years ago
9f682a985b
lvl should not fail on non-existant channels
9 years ago
278c4ab32f
even more jshint compliance
9 years ago
b8e4ad6568
note that kademlia lib should not be used
9 years ago
7553ccff68
Remove a log line which was leftover after debugging
9 years ago
13360c335b
I'm an idiot - killer off-by-one ate the storage
9 years ago
943a291903
Do not blow up if the error is that a chain cannot be found
9 years ago
dff8143fad
Fix the lvl storage
9 years ago
dc9dd25256
added README for writing additional storage adaptors
9 years ago
9b56cbbaca
guarantee ordering when using leveldb back end
...
startup might be a little bit slower now
but we shouldn't see "too much recursion" errors
closes #6 (in theory)
9 years ago
28387f8c90
reformat a console.log
9 years ago
23783bc8ae
kad.js : work on kademlia integration a bit more
9 years ago
1fe2219375
kad.js : remove second hardcoded dht node
9 years ago
9b684c6dbe
kad.js : implement store api using kademlia
9 years ago
862a96439a
lvl.js : implement store api using leveldb
9 years ago
30bee6504e
amnesia.js : put the 'db' and closures inside the the module's 'create' method, in case we ever want to call it twice, for some reason
9 years ago
7c2d9e061f
amnesia.js : correct typo
9 years ago
2e9f32cd10
amnesia.js : remove log statement that would otherwise get really annoying really quickly
9 years ago
3928c89d35
relocate and rename Storage.js. implement a simple, non-persistent in memory datastore for those who'd rather not bother with mongodb. Continue to default to previous values.
9 years ago
ansuz