# 2017-07-11 - Issue with Project Discovery Evaluation Set **URL:** \ **Category:** Announcements\ **Tags:** official, project-discovery\ **Created:** [July 11, 2017, 6:18pm UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765 "2017-07-11T18:18:08Z")\ **Posts on this page:** 20\ **Page:** 8
**Author:** ![Rhydic\_Ujbikist](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/rhydic_ujbikist/32/212628_2.png) [@Rhydic\_Ujbikist](https://forums.eveonline.com/u/Rhydic_Ujbikist)\ **Post date:** [July 13, 2017, 5:08am UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/146 "2017-07-13T05:08:08Z")
This game is actually ridiculous. I was able to maintain perfect accuracy and do 5-6 samples per minute with the first iteration of PD. I did thousands of those slides because they were interesting and consistent and the baseline samples made sense. For this round, though, unless I spam “no transit” when it isn’t immediately obvious, I am down to two or three per minute and I cannot get above about 70% accuracy before tanking back down to 55 or 60 because of imaginary transits that are completely indistinguishable from random noise. This isn’t fun or worthwhile. I don’t really even care about the accuracy of my output anymore because if I can’t be provided with coherent and consistent samples I don’t think I’m going to return coherent and consistent data. There is literally no benefit from an accuracy standpoint for me to put effort into each slide when I can just continually spam no transit until I get an easy reference sample. [[Album] Imgur: The magic of the Internet ![](https://i.imgur.com/WwLs1Pu.jpg?fb "Imgur: The magic of the Internet") ](https://imgur.com/a/QOofP) Do you want me to spam no transit? Because this is how you get me to spam no transit. This is one of the better ones. ---
**Author:** ![Aurora\_Kring](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/aurora_kring/32/7880_2.png) [@Aurora\_Kring](https://forums.eveonline.com/u/Aurora_Kring)\ **Post date:** [July 13, 2017, 8:21am UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/147 "2017-07-13T08:21:37Z")
While you would get a better line-up if you used the detrend tool, it probably still wouldn’t have made any sense. ---
**Author:** ![Madras\_Dawnkeeper](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/madras_dawnkeeper/32/296966_2.png) [@Madras\_Dawnkeeper](https://forums.eveonline.com/u/Madras_Dawnkeeper)\ **Post date:** [July 13, 2017, 8:37am UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/148 "2017-07-13T08:37:03Z")
I think you should include the full window in the screenshots as it shows the number of the sample in the lower right corner after failing. ---
**Author:** ![zluq\_zabaa](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/zluq_zabaa/32/19011_2.png) [@zluq\_zabaa](https://forums.eveonline.com/u/zluq_zabaa)\ **Post date:** [July 13, 2017, 9:28am UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/149 "2017-07-13T09:28:13Z")
![image](https://global.discourse-cdn.com/eveonline/original/2X/4/4156226ed53935a66696134baeeecaa31ee19c30.png) Sample No: 200179159 These samples still appear all the time. How am I supposed to distinguish between the yellow marked area and anything else in that sample? (I used detrend, zoom etc.) ---
**Author:** ![Pleasure\_Hub\_Node-514](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/pleasure_hub_node-514/32/381326_2.png) [@Pleasure\_Hub\_Node-514](https://forums.eveonline.com/u/Pleasure_Hub_Node-514)\ **Post date:** [July 13, 2017, 10:07am UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/150 "2017-07-13T10:07:04Z")
Sample 200109146. I got that one as well. 😕 ![image](https://global.discourse-cdn.com/eveonline/original/2X/f/fd1f9ec33655dd2e852ca2e8217801fa62fbf5d7.jpg) ---
**Author:** ![event\_mocean](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/event_mocean/32/7891_2.png) [@event\_mocean](https://forums.eveonline.com/u/event_mocean)\ **Post date:** [July 13, 2017, 10:21am UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/151 "2017-07-13T10:21:29Z")
1/1000th positioning near unlimited cycle times yeilds total online community annoyed. The nerf hammer is strong with this new mini game. So what devs will be dressing like Thor this Halloween? Between this mini game or (hear me out) bashing my head on the desk with frustration… Fun factor is leaning towards the latter, so time to move keyboard. ---
**Author:** ![zluq\_zabaa](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/zluq_zabaa/32/19011_2.png) [@zluq\_zabaa](https://forums.eveonline.com/u/zluq_zabaa)\ **Post date:** [July 13, 2017, 10:43am UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/152 "2017-07-13T10:43:07Z")
![image](https://global.discourse-cdn.com/eveonline/original/2X/7/796cd895a43d611709b97d81ead81b58aaeb7511.png) Sample 200147923 I suppose in cases of slightly deviating orbital times you get such results. You can’t get them all in a perfect “line” because they aren’t in reality. Any possibility to add some modifier to let us tell you about it? @CCP_Leeloo ---
**Author:** ![Dior\_Ambraelle](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/dior_ambraelle/32/393685_2.png) [@Dior\_Ambraelle](https://forums.eveonline.com/u/Dior_Ambraelle)\ **Post date:** [July 13, 2017, 10:47am UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/153 "2017-07-13T10:47:10Z")
The interesting about this picture is the left side: there is something that looks like a transit, but isn’t marked. ---
**Author:** ![zluq\_zabaa](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/zluq_zabaa/32/19011_2.png) [@zluq\_zabaa](https://forums.eveonline.com/u/zluq_zabaa)\ **Post date:** [July 13, 2017, 10:54am UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/154 "2017-07-13T10:54:31Z")
Yes there are many cases like this. In the tutorial it says that most samples don’t include transits, so I go only with things that either look like a very specific “V” over a number of markers or just select “No Transits”. Reason being that most celestial objects should impact the light curve more than on just one marker. The only problem with this minigame is, that on many samples we have no way to distinguish between a “good” transit and just some other form of deviation. Btw, this is another one I just got… that’s no fun 😡 ![image](https://global.discourse-cdn.com/eveonline/original/2X/2/2bc838585f4d60984ff8f178ee0199a5c854a527.png) ---
**Author:** ![Nazzarus](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/nazzarus/32/316932_2.png) [@Nazzarus](https://forums.eveonline.com/u/Nazzarus)\ **Post date:** [July 13, 2017, 11:56am UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/155 "2017-07-13T11:56:36Z")
we need a probability algorithm or something that gives us a “Hey these markers might be a transit” on these super random level 5s. Also the controls need to be re-evaluated. ---
**Author:** ![Edriss](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/edriss/32/327913_2.png) [@Edriss](https://forums.eveonline.com/u/Edriss)\ **Post date:** [July 13, 2017, 12:12pm UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/156 "2017-07-13T12:12:29Z")
It looks like the first transit you selected was towards the left side of the graph. The small error in the period accumulated through most of the graph. To limit this error, try to select the first transit as close as possible to the middle of the graph. This way, a small error in the period will accumulate through only half of the graph. ---
**Author:** ![zluq\_zabaa](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/zluq_zabaa/32/19011_2.png) [@zluq\_zabaa](https://forums.eveonline.com/u/zluq_zabaa)\ **Post date:** [July 13, 2017, 12:20pm UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/157 "2017-07-13T12:20:53Z")
I will try that, thanks. In the other example I posted before, though, you can cleary see how the orbits are getting longer. ---
**Author:** ![Commander\_Aeris](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/commander_aeris/32/71914_2.png) [@Commander\_Aeris](https://forums.eveonline.com/u/Commander_Aeris)\ **Post date:** [July 13, 2017, 12:30pm UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/158 "2017-07-13T12:30:04Z")
Just had another dafuq moment ![image](https://global.discourse-cdn.com/eveonline/original/2X/a/a85e8f34b41012bdb307290c49cff0d439d855d4.jpg) So ok, I missed some dips, but the bigest dip at 2 days and 18 days aren’t? Lets check the folded transits that are supposed to be there: ![image](https://global.discourse-cdn.com/eveonline/original/2X/f/f26e19428ec3daf8830c90d57e68e57982a5746a.jpg) …dafuq? ---
**Author:** ![Commander\_Aeris](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/commander_aeris/32/71914_2.png) [@Commander\_Aeris](https://forums.eveonline.com/u/Commander_Aeris)\ **Post date:** [July 13, 2017, 12:37pm UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/159 "2017-07-13T12:37:48Z")
![image](https://global.discourse-cdn.com/eveonline/original/2X/e/ecaa5461f0a3bd6d69fa5d131836f7b1cca1aae4.jpg) Because the ‘peak’ at 24 days is a ‘bigger dip’ than at 26 days… Please remove all the samples that have been analysed from samples longer than the 28 days we get to work with. ---
**Author:** ![Commander\_Aeris](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/commander_aeris/32/71914_2.png) [@Commander\_Aeris](https://forums.eveonline.com/u/Commander_Aeris)\ **Post date:** [July 13, 2017, 1:01pm UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/160 "2017-07-13T13:01:39Z")
![image](https://global.discourse-cdn.com/eveonline/original/2X/5/54ce1ea2e791c8cd500df0fbcf12debb83cb7444.jpg) Yeah… not for human eyes. 1/3 of the dips are above the mean… as can be seen by the yellow peak in the middle of the dip, which makes it very hard to see a consistent dip in the sample. ---
**Author:** ![Commander\_Aeris](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/commander_aeris/32/71914_2.png) [@Commander\_Aeris](https://forums.eveonline.com/u/Commander_Aeris)\ **Post date:** [July 13, 2017, 1:32pm UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/161 "2017-07-13T13:32:18Z")
![image](https://global.discourse-cdn.com/eveonline/original/2X/4/45d079fb23ff80346d9659968a3bc102c7d45918.jpg) As stated by others, this sample is 100% bugged. please reimburse my accuracy ~\_~ ---
**Author:** ![Commander\_Aeris](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/commander_aeris/32/71914_2.png) [@Commander\_Aeris](https://forums.eveonline.com/u/Commander_Aeris)\ **Post date:** [July 13, 2017, 1:48pm UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/162 "2017-07-13T13:48:01Z")
![image](https://global.discourse-cdn.com/eveonline/original/2X/b/b1bfc3ae78f835e5b1f334f477967ac025532939.jpg) 1. This is a really hard one 2. The points are scattered all over the place, as in above and below the mean 3. The interval is shorter than we can set for a single transfer interval… so either we need to set up two transfer intervals at 1/2 of each other or this is just too difficult with the current toolset Edit \> ok upon re-evaluation this isn’t shorter than the mininmum interval, however this does create a precedent for false-positives in the consensus samples. ---
**Author:** ![Commander\_Aeris](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/commander_aeris/32/71914_2.png) [@Commander\_Aeris](https://forums.eveonline.com/u/Commander_Aeris)\ **Post date:** [July 13, 2017, 2:00pm UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/163 "2017-07-13T14:00:30Z")
![image](https://global.discourse-cdn.com/eveonline/original/2X/4/40f309708ea0094f8dadd48b4ae05910f105f426.jpg) ![image](https://global.discourse-cdn.com/eveonline/original/2X/5/5790c5bf43b7281af37034b87528808a5ea184eb.jpg) ![image](https://global.discourse-cdn.com/eveonline/original/2X/0/072089163d5a7746cfc5db9ca182a9d332b947eb.jpg) Another really difficult one. 1. My 2nd transit’s red dots overlap the yellow dots of a missed transit so they should’ve counted green/correct… 2. No dip visible when checking the control fold. ---
**Author:** ![Eternal\_Griever](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/eternal_griever/32/381333_2.png) [@Eternal\_Griever](https://forums.eveonline.com/u/Eternal_Griever)\ **Post date:** [July 13, 2017, 2:17pm UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/164 "2017-07-13T14:17:43Z")
If you look at your graph you’ll notice on the left side the transit markers are close to the right of the actual transit while the ones on the left are close to the left side. If you increased the orbit/interval time you would actually mark it. It’s not impossible, you just had the wrong orbit time set. ---
**Author:** ![Eternal\_Griever](https://sea1.discourse-cdn.com/eveonline/user_avatar/forums.eveonline.com/eternal_griever/32/381333_2.png) [@Eternal\_Griever](https://forums.eveonline.com/u/Eternal_Griever)\ **Post date:** [July 13, 2017, 2:19pm UTC](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765/165 "2017-07-13T14:19:33Z")
The interval is not shorter than half a day (although very close to 0.5) so you can actually mark it with one transfer interval. But that still doesn’t change the fact it’s pure luck to find transits like this. [Previous page](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765.md?page=7) [Next page](https://forums.eveonline.com/t/2017-07-11-issue-with-project-discovery-evaluation-set/9765.md?page=9)