tag:blogger.com,1999:blog-1931373673946954854.post3499346590456789539..comments2024-03-25T16:46:43.073+01:00Comments on Prawns and Probability: Rethinking RetractionsRichard Mannhttp://www.blogger.com/profile/13769786662205310175noreply@blogger.comBlogger5125tag:blogger.com,1999:blog-1931373673946954854.post-86374975459771207512017-07-28T03:40:33.824+02:002017-07-28T03:40:33.824+02:00I really like you post,Thanks for your sharing.
ห...I really like you post,Thanks for your sharing.<br /><br /><a href="https://movie-review-2017.blogspot.com" rel="nofollow">หนังออนไลน์</a>vaiyborahttps://www.blogger.com/profile/05095754542895387700noreply@blogger.comtag:blogger.com,1999:blog-1931373673946954854.post-85506755365338341592013-07-18T23:06:39.451+02:002013-07-18T23:06:39.451+02:00Thanks for your comment Brad. You're right, ma...Thanks for your comment Brad. You're right, making sure you can infer back from simulations is definitely a good sanity check - I've caught many other bugs that way! Turns out you can even write a whole paper just doing that! http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0022827<br /><br />One problem that might come up though is if you share some code between sims and inference - for example I have code which calculates which animals are in each others `neighbourhood', which is often used in both.Richard Mannhttps://www.blogger.com/profile/13769786662205310175noreply@blogger.comtag:blogger.com,1999:blog-1931373673946954854.post-39084095617386976962013-07-18T20:35:47.148+02:002013-07-18T20:35:47.148+02:00Incidentally, insprired by your prawn paper, we...Incidentally, insprired by your prawn paper, we're applying a machine learning algorithm with a Markov Chain model to clean up errors in a Drosophila group-choice video tracking experiment. One broad class of bug-checks we're rigorously implementing, which might or might not have been useful in your particular case, is to simulate data using a model, then use the algorithm on the simulalted data to see if we recover the same model at the end. This kind of sanity check has uncovered more bugs than I care to admit.BradFoleyhttps://www.blogger.com/profile/11739815026825472629noreply@blogger.comtag:blogger.com,1999:blog-1931373673946954854.post-34996469215689509152013-07-18T19:45:18.618+02:002013-07-18T19:45:18.618+02:00It was a lovely paper, regardless. And I'm gla...It was a lovely paper, regardless. And I'm glad it turned out well! Maybe selfishly I'm glad other people have similar problems with code. I've had sleepless nights and days with false alarms, and not-false alarms, with an ABC analysis we've been working on.BradFoleyhttps://www.blogger.com/profile/11739815026825472629noreply@blogger.comtag:blogger.com,1999:blog-1931373673946954854.post-11915417769630963262013-03-09T18:49:39.027+01:002013-03-09T18:49:39.027+01:00The bug was extremely subtle, since all the downst...The bug was extremely subtle, since all the downstream plots looked just fine. There was no way to spot it just from looking at the code of any one file - I only spotted it by accident when I noticed that the cached data was much smaller than the original. <br /><br />I've been working on a set of sanity checks to catch errors of this sort automatically, but I haven't been able to come up with one that would have caught this kind of error.<br /><br />At the time it was obvious that this was going to be a painful experience, and hard to handle as gracefully as you did. Kudos for bringing to light such a sensitive aspect of research.<br />Anonymoushttps://www.blogger.com/profile/13796871647825845989noreply@blogger.com