What kind of rate limiting should my RSS parser use for Mangadex's feeds?

BlackHandScans

Group Leader
Joined
Jan 22, 2018
Messages
25
Hi there!

I've made my own RSS parser to keep track of the 100+ manga I'm following. However, my app has been getting a lot of 503 responses lately after I improved it's concurrency. So my question is: how many concurrent RSS feed requests per second do you allow?
I currently fetch the feeds every 10 minutes and parse five feeds at a time with a one-second wait in between each batch of five.

Also should I use a specific User-Agent so you can recognize my RSS parser?
 
Reduce it to 3 concurrent hits, and you should be ok.
 

Users who are viewing this thread

Back
Top