08:12:16 GMT <elfranne> (kinda new to redis) So i got a redis server with a db bigger than my ram, crushing my server ... any advice how to proceed ?
08:12:43 GMT <badboy_> buy more or ram or use less memory
08:13:10 GMT <elfranne> can i load half the db ?
08:13:55 GMT <badboy_> no
08:14:02 GMT <badboy_> Redis is all or nothing
08:27:42 GMT <elfranne> well then there's only one way to solve it
08:28:34 GMT <gobbe> two ways. you can also go with redis pack and leverage ssd's as extension to ram ;)
08:31:37 GMT <elcmat> hi
13:51:08 GMT <elcmat> hi
14:12:58 GMT <Numline1> What's up guys. We've recently started getting the following error from random Redis instances
14:13:00 GMT <Numline1> Handled error
14:13:00 GMT <Numline1> ----------------
14:13:00 GMT <Numline1> Predis\Response\ServerException: ERR Error running script (call to f_9bd406a64e43e31f0dde2849660e8cd56f340b85): @user_script:2: @user_script: 2: -MISCONF Redis is configured to save RDB snapshots, but is currently not able to persist on disk. Commands that may modify the data set are disabled. Please check Redis logs for details about the error.
14:13:27 GMT <Numline1> Google says it happens when there's not enough RAM to create a snapshot, but from what I've seen, there's plenty. How much is needed to create such snapshot?
14:13:35 GMT <Numline1> Is it current_usage_of_redis * 2 ?
14:18:26 GMT <badboy_> there might be a multitude of reasons for that and the answer lies in your log file
14:23:56 GMT <Numline1> badboy_ yea, about that - log file says the same, couldn't save snapshot because it couldnt allocate more memory
14:24:05 GMT <Numline1> which leads me to think it peaks during that, I just can't tell how much
14:24:21 GMT <Numline1> also, I'm not sure whether it's able to use a bit of swap too
14:25:52 GMT <badboy_> how much memory does your machine have? how much is redis using? do you have overcommit enabled?
14:26:57 GMT <Numline1> badboy_ we have about 8 instances of our app, each has it's standalone Redis, here's one of the dev servers - https://gyazo.com/05e63216c259da9696781abfc63e22da
14:27:07 GMT <Numline1> I'll have to check what's in it anyway, since it's a lot (70%)
14:27:19 GMT <Numline1> There should only be some small cache and queue
14:27:28 GMT <Numline1> ALso overcommit not enabled, I've read about it yesterday, but I'm not sure it's safe
14:27:48 GMT <badboy_> there you have it, no memory left for redis :)
14:28:53 GMT <Numline1> badboy_ heh figured as much :D I just wonder how much is needed for snapshots :)
14:29:08 GMT <Numline1> Let me check what's in that instance anyway
14:29:28 GMT <badboy_> in the worst case: same amount as is already in use
14:30:17 GMT <badboy_> Redis forks to write the snapshot and without overcommit that will require memory to be allocated
14:33:25 GMT <elcmat> is there any windows version
14:33:33 GMT <badboy_> of?
14:34:19 GMT <Numline1> badboy_ fair enough. I thought overcommit means => allow allocation of more memory than available and then YOLO
14:34:34 GMT <Numline1> btw there's about 7500 hashtables from one of our plugins and nothing else
14:34:37 GMT <Numline1> doesn't seem that much
14:35:04 GMT <badboy_> elcmat: there's a discontinued port of Redis by microsoft: https://github.com/MicrosoftArchive/redis/
14:35:33 GMT <badboy_> Numline1: it basically means that, but thanks to Linux' Copy-on-write you're most often better of when forking
14:35:56 GMT <badboy_> if you are not ok with the disadvantages it brings ensure you have enough free memory for the ofrk
14:37:54 GMT <Numline1> badboy_ yeah, I'll look into that. Thanks a lot man
14:38:16 GMT <Numline1> First solution would be to save less data into Redis
14:38:20 GMT <Numline1> but Medis is so freakin' slow
14:38:28 GMT <Numline1> if that doesn't help/won't be possible, we'll add more RAM
14:38:57 GMT <Numline1> I'll have to put my leg down, we have 96GB on the host server, VPS for this project gets only 4GB/VPS
14:39:02 GMT <Numline1> like, hello
14:39:35 GMT <Numline1> badboy_ one last thing tho - any chance you know about any better UI for mac to use with Redis?
14:39:41 GMT <Numline1> as I said, Medis is kinda awful
14:43:22 GMT <badboy_> redis-cli
14:44:44 GMT <Numline1> badboy_ I was about 99,98% sure you'll say that :D
17:26:51 GMT <elcmat> i'm installing redis 2.4 :( for windows
20:14:05 GMT <minus> that offends me
20:45:00 GMT <applecrumble> Hello, I'm trying to run redis in a distributed way. The dockerhub image (_/redis) doesn't seem to be set up for master/slave mode, is there an option I can pass to redis-server to start in master/slave mode?
20:49:12 GMT <zpojqwfejwfhiunz> you can add "slaveof" to the config file
20:49:14 GMT <zpojqwfejwfhiunz> see https://redis.io/topics/replication
21:23:57 GMT <applecrumble> zpojqwfejwfhiunz: Interesting.. So are slaves supposed to be read only? In other words, I will have a load balancer over many slaves for reading, but must talk to the master specifically to write?
21:25:54 GMT <minus> applecrumble: yes
21:26:27 GMT <minus> if you want to partition data use redis cluster
21:31:55 GMT <zpojqwfejwfhiunz> redis still doesn't have master-master replication, but it's been in the works
21:34:09 GMT <applecrumble> Hmm, I'm really just trying to have high availability for use in a Docker cluster (kubernetes)
21:34:39 GMT <applecrumble> Thanks for the pointers, I'm looking into cluster. It doesn't support NAT, but maybe I can rig it some way..
21:59:34 GMT <saml> is it okay?
21:59:44 GMT <saml> to store 64MB of values to small key
21:59:50 GMT <saml> many small keys.
22:07:32 GMT <zpojqwfejwfhiunz> sure
22:09:18 GMT <zpojqwfejwfhiunz> you can store 512MB
22:09:34 GMT <zpojqwfejwfhiunz> however, are you sure you don't want to store paths to a proper filesystem instead?