04:06:47 GMT <rshetty> We have a requirement to horizontal scale redis nodes. I know using something like Twemproxy you can shard data across multiple nodes and add more nodes on the fly. Is there a way to auto rebalance keys on the fly when a new node is added behind a twemproxy ? Or are there any alternate solutions, Thanks
09:20:36 GMT <minus> rshetty: use redis cluster?
09:22:49 GMT <rshetty> minus: Does it provide auto rebalancing ? And also is redis cluster stable for production ?
09:24:49 GMT <minus> i don't know if it does rebalancing nor what that is. it is stable for production
09:27:18 GMT <minus> https://redis.io/topics/cluster-tutorial is that under "data sharding" what you mean, rshetty?
15:40:00 GMT <syntaxx> Hi, our redis is always OOM.. the server is currently have 40GB of memory.. It is also shared with elastisearch and logstash-indexer. What is the required memory for redis?
15:47:29 GMT <minus> setting maxmemory and enabling overcommit should help
15:47:48 GMT <minus> by default redis consumes until it gets killed i think
15:49:55 GMT <syntaxx> minus, if we set the maxmemory and redis reached it what will happen? it will also get killed? or it will stay but affects performance?
15:50:31 GMT <minus> it will reject writes
15:50:54 GMT <minus> unless you also set an eviction policy
15:51:04 GMT <minus> then it will drop keys
15:54:27 GMT <syntaxx> minus, hmmm okay but normally how many memory is needed for redis?
15:54:59 GMT <minus> redis itself needs ~3MB, the rest depends on what you put into it
16:07:42 GMT <syntaxx> ok minus thanks.. i will try to read about redis maxmemory.. I dont want to lose info if there's any
16:50:33 GMT <syntaxx> what happens when we run flushdb?
16:50:40 GMT <syntaxx> will we lose data?
17:09:42 GMT <minus> yes
17:35:34 GMT <syntaxx> minus, what do you mean data loss.. meaning? index? or actual logs in elasticsearch?
17:36:18 GMT <minus> with flushdb you wipe everything from redis
17:36:32 GMT <syntaxx> ah.. hmm thanks
17:38:05 GMT <minus> since you're feeding logs into ES i assume you just use redis as buffer, in which case it sohuldn't contain much data. if you got 40GB in it you're probably doing something wrong. but i have never used redis for that, so that's just a wild guess
17:39:14 GMT <syntaxx> ok thanks for explaining minus.. i will try to read redis more so I have a better understanding..