{"id":35,"date":"2014-11-20T07:38:00","date_gmt":"2014-11-20T07:38:00","guid":{"rendered":"https:\/\/sandrock.co.za\/carl\/2014\/11\/20\/managing-scientific-data-and-interchange-with-industry\/"},"modified":"2014-11-20T07:38:00","modified_gmt":"2014-11-20T07:38:00","slug":"managing-scientific-data-and-interchange-with-industry","status":"publish","type":"post","link":"https:\/\/sandrock.co.za\/carl\/2014\/11\/managing-scientific-data-and-interchange-with-industry\/","title":{"rendered":"Managing scientific data and interchange with industry"},"content":{"rendered":"<p>I spoke at a recent symposium on the difficulties in managing data interchange with industry.<\/p>\n<p>Just for some context, &#8220;industry&#8221; here stands for personnel involved in process control and modelling activities. My direct experience is in the petrochemical, mining and paper and pulp industries. I also show an example of data from a piece of analytical equipment.<\/p>\n<p>I&#8217;ve uploaded the source on GitHub&nbsp;<a href=\"https:\/\/github.com\/alchemyst\/data-interchange\">here<\/a>, and you can see the notebook without downloading it by using <a href=\"http:\/\/nbviewer.ipython.org\/github\/alchemyst\/data-interchange\/blob\/master\/Data%20interchange.ipynb\">NBViewer<\/a>.<\/p>\n<p>I&#8217;ve spoken about the pattern of intermediates on this blog before (in a slightly different context).<\/p>\n<p>Notably absent from this discussion are any kind of database, since my experience is that if you can&#8217;t e-mail it, it might as well not exist when talking to the kinds of people I work with. I&#8217;ve used sqlite quite extensively myself, but I have found most people want something they can double-click and just have it work.<\/p>\n<p>If you have different experiences, I&#8217;m always eager to learn. I am specifically interested in how people who use client-server databases for their data handle the problem of interchange.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I spoke at a recent symposium on the difficulties in managing data interchange with industry. Just for some context, &#8220;industry&#8221; here stands for personnel involved in process control and modelling activities. My direct experience is in the petrochemical, mining and paper and pulp industries. I also show an example of data from a piece of [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[1],"tags":[],"class_list":["post-35","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/sandrock.co.za\/carl\/wp-json\/wp\/v2\/posts\/35","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sandrock.co.za\/carl\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sandrock.co.za\/carl\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sandrock.co.za\/carl\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/sandrock.co.za\/carl\/wp-json\/wp\/v2\/comments?post=35"}],"version-history":[{"count":0,"href":"https:\/\/sandrock.co.za\/carl\/wp-json\/wp\/v2\/posts\/35\/revisions"}],"wp:attachment":[{"href":"https:\/\/sandrock.co.za\/carl\/wp-json\/wp\/v2\/media?parent=35"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sandrock.co.za\/carl\/wp-json\/wp\/v2\/categories?post=35"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sandrock.co.za\/carl\/wp-json\/wp\/v2\/tags?post=35"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}