What are the technical limits for automatic 3rd party services to integrate on ESI?

EVE Technology and Research Center Third Party Developers
,
1

Hello,

I am dealing with simple game scenario as a common hauler, where I buy stuff cheap on the market and haul it elsewhere where they buy it for a higher price. For this scenario one certainly needs the best and the most current data that can be obtained from all markets in all systems (well 99% this is highsec and lowsec).

Unfortunately, althought ESI provides info about market orders, the API method is limited to systems. There is no bulk data source for whole universe. Data has to be pulled by small portions. To achieve this I am sure there are various web sites which use automated services which constatly and intensivelly call the API and maintain the their local datasource from gathered data. I can give examples like:
https://evetycoon.com/market

Now, I am also building a website to provide global data for markets of the whole universe and want to maintain a local datasource by constant checks via ESI API. Mentioned site eve-trading.net is actually (quite visually) displaying how it is maintaining this process of gathering data from 9 regions of the universe (see Orders Update Time table). My rough estimation is that the way it is done presumes no less than 100 requests/calls to ESI per second. Which is quite intense to my standards. :slight_smile: But it is a proof that it is allowed to run data mining on ESI, cause this site is running for some time with no issue.

So explaining this scenario I come to my logical question.

What are the limits of automated services which are constantly trying to mine data from ESI?
Can anyone provide any intel on this?
What are the possible punishments for overloading ESI API?
Do I have to register somewhere if I want to use ESI in mentioned manner of automated data mining?

Thank you in advance for any relevant advice. :slight_smile:

2

The only limit is caching times. As long as you obey them, there won’t be an issue.
There are no registration required, other than EVE-online account with a payment record at any time in the past (at least that’s my understanding of a present situation).
All ESI interactions are subject to License Agreement - EVE: Developers

1 Like
3

Hello Tanto,
Thank you for your answer. That seems to cover my main question, although I don’t understand what are caching times and how can one obey them. It does not seem to be mentioned anywhere in ESI docs.

4

I thought there were docs on it, but you can check the ETAG ETag - HTTP | MDN to see if what you have stored from your first request is different from what the server has now, that lets you know the cache has updated and you should store the new etag for future comparisons.

I would also pay attention to your error limit ESI Error Rate Limiting Goes Live On Monday - EVE: Developers

1 Like
5

Read the documentation:

At a minimum ready the basic rules:

The WebUI is helpful:
https://esi.evetech.net/ui

You likely want to use library:

1 Like
6

Thank you guys, I value your answers, it solves my issue.

ESI Introduction and the Rules section within it clearly covers the limits.