https://community.wolfram.com RSS Feed for Wolfram Community showing any discussions tagged with Data Drop sorted by new. https://community.wolfram.com/groups/-/m/t/3309116 .. Sujit Mainali 2024-10-27T21:57:55Z https://community.wolfram.com/groups/-/m/t/3269498 I'm thinking myself stupid but I cannot grasp how the `GroupBy` function works, so... I have a `Databin` which consists of timestamped step values (timestamp using the Data Drop's built-in `Timestamp`, and then a numeric value for number of steps recorded), captured by my Apple Watch. I can plot this data as-is, easily enough: ![Daily Step Log][1] But now I want to see a bigger picture, with the total number of steps by day. For the life of me I can't figure out how `GroupBy` is supposed to do this to the point that I'm about ready to switch to something else (like InfluxDB and Python/Pandas, the former of which is designed specifically for time-series data). [1]: https://community.wolfram.com//c/portal/getImageAttachment?filename=stchart.png&userId=3066008 Steven Buehler 2024-09-07T22:19:34Z https://community.wolfram.com/groups/-/m/t/3246264 When submitting a Data Drop Databin for processing with WolframAlpha, I am only getting an ad for Data Drop rather than an analysis of the data (see screenshot). Broken? ![Screenshot of WolframAlpha showing an ad link for Data Drop instead of an analysis of the data in the Databin][1] [1]: https://community.wolfram.com//c/portal/getImageAttachment?filename=Screenshot2024-08-11at8.43.54%E2%80%AFPM.png&userId=3066008 Steven Buehler 2024-08-12T00:46:13Z https://community.wolfram.com/groups/-/m/t/3239729 I'm attempting to set up a `Databin` and want to specify the `Interpretation` property, but the objects that will be posted have nested properties and I can't figure out how to structure the `Interpretation` value to ensure things import as desired. This is an example object; it's a web hook from the Swarm app by Foursquare (the location is "fuzzed" by the application, meaning if you go there you'll end up in a swamp, not my apartment ;-)). You can see that several parts have sub properties that I want to have interpreted. ``` <|"Timestamp" -> DateObject[{2024, 8, 1, 7, 17, 38}, "Instant", "Gregorian", -4.], "id" -> "66ab6ed232bdf611d2e695ef", "createdAt" -> 1722511058, "type" -> "checkin", "visibility" -> "closeFriends", "timeZoneOffset" -> -240, "editableUntil" -> 1722597458000, "venue" -> <|"id" -> "65949b558dc8ae0ff3d196fa", "name" -> "Steven Buehler's Apartment", "location" -> <|"isFuzzed" -> True, "lat" -> 28.35522101686996, "lng" -> -81.68568083681541, "cc" -> "US", "neighborhood" -> "Cagan Crossings", "city" -> "Clermont", "state" -> "FL", "country" -> "United States", "formattedAddress" -> {"Clermont, FL 34714"}|>, "categories" -> {<|"id" -> "4bf58dd8d48988d103941735", "name" -> "Home (private)", "pluralName" -> "Homes (private)", "shortName" -> "Home (private)", "icon" -> <|"prefix" -> "https://ss3.4sqi.net/img/categories_v2/building/home_", "suffix" -> ".png"|>, "categoryCode" -> 12123, "mapIcon" -> "fsq-default", "primary" -> True|>}, "private" -> True, "createdAt" -> 1704237910|>, "likes" -> <|"count" -> 0, "groups" -> {}|>, "like" -> False, "isMayor" -> True, "photos" -> <|"count" -> 0, "items" -> {}|>, "posts" -> <|"count" -> 0, "textCount" -> 0|>, "comments" -> <|"count" -> 0|>, "source" -> <|"name" -> "Steven Buehler's Project"|>|> ``` Steven Buehler 2024-08-01T23:39:31Z https://community.wolfram.com/groups/-/m/t/2798110 Data drop is not importing tweets I am sending to @WolframDataDrop, and the account can't be messaged. Is this feature still working? Steven Buehler 2023-01-20T20:16:39Z https://community.wolfram.com/groups/-/m/t/2497145 Hi Everyone, When I import an image taken with my iPhone, and examine the metadata within Mathematica, it is comprehensive. When I use a FormPage in CloudDeploy to capture images (using "Interpreter"->"Image" in a FormObject) and then CloudDeploy[FormPage[myForm,DatabinUpload[myBin,"image"->#image] everything works great except... when I grab that image from the databin and look at the metadata, it had been heavily altered. Here is an example of 'full' metadata from a directly imported image: {MetaInformation -> <|"Exif" -> <|"GPSLatitudeRef" -> "North", "GPSLatitude" -> Quantity[40.7388, "AngularDegrees"], "GPSLongitudeRef" -> "West", "GPSLongitude" -> Quantity[74.1696, "AngularDegrees"], "GPSAltitudeRef" -> "Above sea level", "GPSAltitude" -> Quantity[0, "Meters"], "Make" -> "Apple", "Model" -> "iPhone 4", "Orientation" -> <|"CameraTopOrientation" -> Top, "Mirrored" -> False|>, "XResolution" -> 72, "YResolution" -> 72, "ResolutionUnit" -> "Inch", "Software" -> "7.1.2", "DateTime" -> DateObject[{2014, 8, 11, 13, 40, 43.}, "Instant"], "YCbCrPositioning" -> "Centered", "ExposureTime" -> Quantity[1/479, "Seconds"], "FNumber" -> "f/2.8", "ExifTag" -> 204, "ExposureProgram" -> "Program", "GPSTag" -> 1126, "ISOSpeedRatings" -> 80, "ExifVersion" -> "2.21", "DateTimeOriginal" -> DateObject[{2014, 8, 11, 13, 40, 43.}, "Instant"], "DateTimeDigitized" -> DateObject[{2014, 8, 11, 13, 40, 43.}, "Instant"], "ComponentsConfiguration" -> "YCbCr", "ShutterSpeedValue" -> Quantity[14272/1603, IndependentUnit["exposure values"]], "ApertureValue" -> Quantity[4281/1441, IndependentUnit["exposure values"]], "BrightnessValue" -> 8157/1009, "MeteringMode" -> "Multi-segment", "FlashInfo" -> <|"FlashUsed" -> False, "FlashFiringStatus" -> "No strobe return detection function", "FlashMode" -> Automatic, "FlashFunctionPresent" -> True, "RedEyeCorrection" -> False|>, "FocalLength" -> Quantity[3.85, "Millimeters"], "SubjectArea" -> Rectangle[{1891/2, 619}, {3289/2, 1315}], "MakerNote" -> ByteArray[CompressedData[" 1:eJxTTMoPSmJkYGAwABKOBQU5qQqZ/sEMDIy+vgxsDIwMnEApkDQDAxMDO5DM AeIYBmYwOwOITzCwwNUwAnXA2JeAKhDiQJBUkJNZXGJg4C/goGNiZdD9ZPpW J2ez4l//30Q6Ghqr2p74XG2mayLExeV6wNzYJ1iNm7PQytjGWoufV1hdnk9A jJ9bwEyQg52bnZONA+weBkaIu2DuQwBvmF1XGJmYWVjZ2DlC03IS04tDyxJz SlNDUwvykzMiSzJzU4uTE3NSBRiFGRhUuzPe7+AVYBCynnWKgUNQXFZZV9/C Cs0eTjR77AFykzL2 "]], "SubSecTime" -> "000", "SubSecTimeOriginal" -> "000", "SubSecTimeDigitized" -> "000", "FlashpixVersion" -> "1.00", "ColorSpace" -> "RGBColor", "PixelXDimension" -> 2592, "PixelYDimension" -> 1936, "SensingMethod" -> "One-chip color area", "SceneType" -> "Directly photographed", "ExposureMode" -> Automatic, "WhiteBalance" -> Automatic, "FocalLengthIn35mmFilm" -> Quantity[35, "Millimeters"], "SceneCaptureType" -> "Standard", "LensSpecification" -> {2018451/524273, 2018451/524273, 14/5, 14/ 5}, "LensMake" -> "Apple", "LensModel" -> "iPhone 4 back camera 3.85mm f/2.8"|>|>} Here is an example after an image has gone through the DataBin: {MetaInformation -> <|"Exif" -> <|"ImageWidth" -> 3024, "ImageLength" -> 4032, "Orientation" -> <|"CameraTopOrientation" -> Top, "Mirrored" -> False|>, "XResolution" -> 72, "YResolution" -> 72, "ResolutionUnit" -> "Inch", "Software" -> "Created with the Wolfram Language : www.wolfram.com", "DateTime" -> DateObject[{2022, 3, 24, 14, 18, 11.}, "Instant", "Gregorian", -4.], "ExifTag" -> 228, "TimeZoneOffset" -> -4, "ColorSpace" -> "Uncalibrated", "PixelXDimension" -> 4032, "PixelYDimension" -> 3024|>, "Comments" -> <|"Software" -> "Created with the Wolfram Language : www.wolfram.com", "Creation Time" -> DateObject[{2022, 3, 24, 14, 18, 11.}, "Instant"]|>|>} And if I extra the metadata as part of the form action, putting it in it's own key in the DataBin, I only get this: {MetaInformation -> <|"Exif" -> <|"Orientation" -> \ <|"CameraTopOrientation" -> Top, "Mirrored" -> False|>, "ExifTag" -> 38, "ColorSpace" -> "Uncalibrated", "PixelXDimension" -> 4032, "PixelYDimension" -> 3024|>|>} Does anyone know why so much of the metadata is being lost? Is it an Apple thing, for security? Really what I want to capture are the GPS coordinates. It's for a research project. Gareth P.S. I can post the exact code I'm using, but for it to work for someone else I'll need to make a public databin, etc. Before I do that, I wondered if anyone just knows why this is happening. Gareth Russell 2022-03-24T18:25:13Z https://community.wolfram.com/groups/-/m/t/2468777 I want to upload a video clip to the Wolfram cloud and then access it from the cloud for video processing in the cloud. I saved a video clip to a databin as follows - first I create a FormObject CloudDeploy[ FormPage[ {"video" -> QuickTime | MP4}, DatabinAdd[myDB, #video] &], Permissions -> "Public" ] Then I access the URL returned by the CloudDeploy I get a form to upload a video, which I do. What I see in the databin is Video["/tmp/UserTemporaryFiles/public/13673/4d1/4d1c2014-ae34-4e3b-\ 80ba-8d2da7d6aa43/upload-directory-0/trim.5D7FEF2A-41DA-430C-B5BF-\ 7C37C80997D9.MOV", Appearance -> Automatic, AudioOutputDevice -> Automatic, SoundVolume -> Automatic] I do the following in the cloud in a cloud notebook, attempting to create a Video object from the tmp file vid = Video["/tmp/UserTemporaryFiles/public/13673/4d1/4d1c2014-ae34-4e3b-80ba-\ 8d2da7d6aa43/upload-directory-0/trim.5D7FEF2A-41DA-430C-B5BF-\ 7C37C80997D9.MOV"] And I get the dreaded File not found error. So my question is - Is it possible to save a video clip as a binary object to a databin and retrieve it for video processing? It seems like the uploaded file is saved to a tmp file and then deleted before it can be accessed. So how do I achieve what I am trying to do as stated in the first sentence? Thanks much. Nitin Borwankar 2022-02-11T00:53:18Z https://community.wolfram.com/groups/-/m/t/2306082 Hi all, we have a free webinar coming up on Monday 12th July at 3pm BST. This interactive demonstration will cover how you can use automation to effortlessly infer structure and remove noise from unstructured sources and use innovative computational methods and semantic analysis to drive insight from otherwise suboptimal sources. Registration link: http://wolfr.am/WNvyO8NK If you have any questions, please feel free to email us on events-europe@wolfram.com ![enter image description here][1] [1]: https://community.wolfram.com//c/portal/getImageAttachment?filename=ScreenShot2021-07-06at11.07.20AM.png&userId=11733 Idowu Badmus 2021-07-06T15:11:37Z https://community.wolfram.com/groups/-/m/t/2107988 I have a hosted database in CENT OS on an ESXI host with VM ware. I need to be able to connect to this to push pull data. If there is any documentation for this specifically on prior users doing this, I would love to have it. I have read all through DatabaseLink documentation and probably need to read through it again, but I believe the connection to the server need to occur with IP, Port, Socket connection, etc. I may be wrong, but any help is good. Luke Jennings 2020-11-05T01:34:35Z https://community.wolfram.com/groups/-/m/t/2090365 Hi guys, I was trying to reproduce what Bernat does here (https://community.wolfram.com/groups/-/m/t/456947) but an error is showing: Get::noopen: Cannot open /home/pi/.Mathematica/Paclets/Repository/Interpreter-1.3.140.0/Kernel/32Bit/Interpreter.mx Does anyone knows how to solve it? - I am using a Raspbery pi 3B+ with Wolfram Mathematica 12.1 on Raspbian. I also saw a post on stack exchange about the same error: https://mathematica.stackexchange.com/questions/231331/a-function-failes-and-a-message-appears-only-on-raspbery-pi-os?noredirect=1 Thanks. Estevao Teixeira 2020-10-07T16:27:09Z https://community.wolfram.com/groups/-/m/t/2016353 Is Data Drop a serious product that Wolfram intends on offering as a product? It has been in beta for several years and there is not very much information available aside from how to use it. Is this product interned to be used only for hobbyists or is there a point when it will be out of Beta? John Stewart 2020-06-30T00:17:00Z https://community.wolfram.com/groups/-/m/t/1991954 Hello, Wolfram reports that my databin has 273 entries, but then immediately contradicts itself by reporting that it has only 255 entries. Please see below - any idea what is going wrong? ![enter image description here][1] [1]: https://community.wolfram.com//c/portal/getImageAttachment?filename=2020-06-0112_10_38-Untitled-1_-WolframMathematica12.0.png&userId=1642550 Andrew Read 2020-06-01T04:15:04Z https://community.wolfram.com/groups/-/m/t/1852128 Hi, I had the IFTTT integration working before NYE, but after, it just times out. Anyone else experience the same? ![IFTTT activity screenshot][1] Thanks, Jo [1]: https://community.wolfram.com//c/portal/getImageAttachment?filename=Screenshot_20200104-065223_IFTTT.jpg&userId=1852110 Joe Hetland 2020-01-04T06:02:31Z https://community.wolfram.com/groups/-/m/t/1849339 [![enter image description here][1]](https://www.wolframcloud.com/env/silviah/Published/xmas.html) **POSTCARD:** https://www.wolframcloud.com/env/silviah/Published/xmas.html &[embedded notebook][2] [1]: https://community.wolfram.com//c/portal/getImageAttachment?filename=Xmas_postcard.jpg&userId=20103 [2]: https://www.wolframcloud.com/obj/5d66a4c6-13dc-43c9-9885-2df6e44a0a6f Silvia Hao 2019-12-29T14:07:04Z https://community.wolfram.com/groups/-/m/t/1797647 I am working on building a repository that would allow organizations to track energy consumption over time for multiple buildings. I have created an EntityStore where the buildings are the registered entities. Each building's data is stored in a Databin. I am trying to create a page where each building's data can be viewed as a DateListPlot. I created a function that returns a DateListPlot of a specific building's utility bills. The structure of the data in the Databin is: ![enter image description here][1] The DateListPlot function is: campusBuldingMonthlyBills[campusbuilding_] := DateListPlot[ TimeSeries@ Map[{#["DATE"], #["KWH"]} &, Normal[Dataset[ EntityValue[Entity["Campus Building", campusbuilding], "monthly bills"]]]]] The function works well when used alone. ![enter image description here][2] Unfortunately, when I use the function within TabView an error is occuring, and I can't figure it out why. Here is my TabView code. TabView[Row[{Rasterize[ Show[EntityValue[#, "image"], ImageSize -> {40, 40}], Background -> None], #}] -> campusBuldingMonthlyBills[#] & /@ EntityList["Campus Building"], ControlPlacement -> Left] Here is a copy of one of the error messages: DateListPlot::ldata: TimeSeries[EntityValue[{ Entity[Campus Building,weld][DATE], Entity[Campus Building,weld][KWH]}, {monthly bills[DATE],monthly bills[KWH]}]] is not a valid dataset or list of datasets. Here is what the output of the TabView looks like: ![enter image description here][3] I'm clearly missing something, but I'm not seeing why my code isn't working. If anyone has any insight I would greatly appreciate it! Thank you, Kyle MacLaury [1]: https://community.wolfram.com//c/portal/getImageAttachment?filename=DatabinEntry.PNG&userId=1726628 [2]: https://community.wolfram.com//c/portal/getImageAttachment?filename=campusBuilding.PNG&userId=1726628 [3]: https://community.wolfram.com//c/portal/getImageAttachment?filename=TabView.PNG&userId=1726628 Kyle MacLaury 2019-09-29T17:13:54Z https://community.wolfram.com/groups/-/m/t/1729785 ## Introduction ## ![enter image description here][1] The World Meteorological Organization has over 11,000 weather stations around the world. The data from these devices are continuously recorded into public databases and made available for anyone to download and analyze. Meteorologists regularly inform their viewers with reports produced by Weather, Research & Forecast (WRF) models which analyze these aggregated datasets. In addition to the WMO's stations, there are also civilian owned weather stations that inform platforms like Weather Underground, AcuRite, and Weather Bug. Unfortunately, those companies do not share the profits they generate off the data they collect from the community. Also, AcuRite no longer offers a public API for their users to easily access their own data. Even worse, WeatherBug has [been caught selling][2] private location data about its users to third parties. Concerns for privacy and data ownership are on the rise. Though Facebook experienced moderate backlash for its role in the Cambridge Analytica scandal, many opine the reaction was insufficient. Switching costs remain high while data produced by users remains hosted on the platform's servers. One way to deal with this is to back up your own data in a secondary location such that it's available for personal use any time. Insert your own myAcuRite login credentials into the code below and then evaluate the cell to obtain a table of the latest reading from your personal weather station. After the code retrieves the current data feed, it will be inserted into the Wolfram Blockchain and a public databin which can be accessed [here][3]. If the data is successfully inserted into the blockchain and recalled without changing the data, "True" will appear above the weather table. Note this also creates a Scheduled Task and Cloud Deploy to automatically retrieve your weather data once per hour. Also, feel free to create your own databin and replace the name with your own in the DatabinAdd[ ] line of code. Typical Output from a weather station is shown in the table above. isoStringWithTZToDateObject[string_String]:= (* by Jesse *)Module[{stringParts=StringSplit[string,RegularExpression["(?=((\\+|-)\\d{2}:\\d{2})|Z$)"]],tzpart,tzoffset,signedtzoffset},Which[Length[stringParts]===1,signedtzoffset=Automatic,ToUpperCase[stringParts[[2]]]==="Z",signedtzoffset=0,True,tzpart=StringSplit[stringParts[[2]],{RegularExpression["(?<=\\+|-)"],":"}]; tzoffset=NumberCompose[FromDigits/@Rest[tzpart],{1,1/60}]; signedtzoffset=N@If[tzpart[[1]]==="-",-tzoffset,tzoffset];]; DateObject[stringParts[[1]],TimeZone->signedtzoffset]]; (*frequency=15min;*) frequency=Quantity[60,"Minutes"]; stask=ScheduledTask[Module[{ loginData, mytoken, myaccountid, hubsData, myhubid, weatherfeed, deviceRawData, sensorRawData, sensorUnits, sensorData, weatherEntry, weatherHash, list, trxID }, (*Send a login request with username and password to get a session token and account ID*) loginData=URLExecute[HTTPRequest[<| Method->"POST", "Scheme"->"https", "Domain"->"marapi.myacurite.com", "Path"->"/users/login", "ContentType"->"application/json", "Body"->ExportString[ <| "email"->"YourEmailHere", "password"->"YourPasswordHere", "remember"->"True" |>, "RawJSON"] |>],"RawJSON"]; mytoken=loginData["token_id"]; myaccountid=loginData[["user","account_users",1,"account_id"]]; (*Find the ID of the particular weather station in question*) hubsData=URLExecute[HTTPRequest[<| Method -> "GET", "Scheme" -> "https", "Domain" -> "marapi.myacurite.com/accounts/"<>ToString[myaccountid]<>"/dashboard/hubs","ContentType"->"application/json", "Headers" -> {"x-one-vue-token" -> mytoken} |>],"RawJSON"]; myhubid=hubsData[["account_hubs",1,"id"]]; (*Obtain the current data feed from the particular weather station*) weatherfeed=URLExecute[HTTPRequest[<| Method -> "GET", "Scheme" -> "https", "Domain" -> "marapi.myacurite.com/accounts/"<>ToString[myaccountid]<>"/dashboard/hubs/"<>ToString[myhubid], "ContentType"->"application/json", "Headers" -> {"x-one-vue-token" -> mytoken} |>],"RawJSON"]; (*Organize data. Consider cases with different units*) deviceRawData=weatherfeed[["devices",1]]; sensorRawData=AssociationThread[deviceRawData[["sensors",All,"sensor_name"]]->deviceRawData[["sensors"]]]; sensorUnits=<| "Temperature"->Switch[sensorRawData["Temperature","chart_unit"],"F","DegreesFahrenheit","C","DegreesCelsius"], "Pressure"->Switch[sensorRawData["Pressure","chart_unit"],"inHg","InchesOfMercury","hPa","Hectopascals"], "Humidity"->"Percent", "Wind Speed"->Switch[sensorRawData["Wind Speed","chart_unit"],"mph","Miles"/"Hours","km/h","Kilometers"/"Hours","kn","Knots"],"Wind Direction"->"Degrees", "Rainfall"->Switch[sensorRawData["Rainfall","chart_unit"],"in","Inches","mm","Millimeters"], "Dew Point"->Switch[sensorRawData["Dew Point","chart_unit"],"F","DegreesFahrenheit","C","DegreesCelsius"], "Feels Like"->Switch[sensorRawData["Feels Like","chart_unit"],"F","DegreesFahrenheit","C","DegreesCelsius"], "Wind Speed Average"->Switch[sensorRawData["Wind Speed","chart_unit"],"mph","Miles"/"Hours","km/h","Kilometers"/"Hours","kn","Knots"] |>; sensorData=<|"Sensor"->#["sensor_name"],"Value"->Quantity[#["last_reading_value"],sensorUnits[#["sensor_name"]]]|>&/@Values@sensorRawData; (*Include timestamp, latitude, longitude, and elevation into the table*) weatherEntry=dataTable=<| "Sensors"->sensorData, "ReadingTimestamp"->TimeZoneConvert[isoStringWithTZToDateObject[deviceRawData["last_check_in_at"]]], "SubmisisonTimestamp"->Now, "Position"->GeoPosition[Append[ Interpreter["Real"][{weatherfeed["latitude"],weatherfeed["longitude"]}], Quantity[weatherfeed["elevation"],Switch[weatherfeed["elevation_unit"],"ft","Feet","m","Meters"]]]] |>; (*Insert the weatherEntry and its hash into the Wolfram Blockchain and a Databin*) previousHash=Hash[Normal[Databin["EM6FHeXi",-1]][[1,2]],"SHA256"]; list={previousHash, weatherEntry}; trxID=BlockchainPut[list]; listDB={previousHash, Hash[weatherEntry,"SHA256"],trxID}; DatabinAdd["EM6FHeXi",listDB]; ],frequency]; task=SessionSubmit[Evaluate@stask]; obj=CloudDeploy[stask,"BlockchainWeatherUpdate"] As seen in the code above and the image below, three entries are inserted into a databin. The first is a hash of the previous databin entry, the second is a hash of the current weather entry, and finally a receipt from inserting the weather entry into the Wolfram Blockchain. Use BlockchainGet[ ] with that receipt to retrieve the weather data for that entry. ![enter image description here][4] ## Where are additional weather stations needed? ## Data deserts in the field of meteorology exist in places like northern Canada, inland China, and North Africa. One of the largest factors contributing to weather forecasting inaccuracy is a lack of data from these areas. A typical World Meteorological Organization weather station costs several thousand dollars for a government to install. Deciding where to install new weather stations depends on several factors such as weather patterns, population centers, budgets, and accessibility. Though local governments may not have the budget to install an official WMO station, it is still important to collect data generated from local denizens. Use the cell below to import the dataset of WMO stations and plot random points in a variety of countries, then determine the average distance to the nearest WMO Station. As can be seen, the United States has a higher density of weather stations than Canada, while France has even more and Algeria has barely any. WMOStations=ResourceObject["WMO Meteorological Stations"]; WMOLocations=Values@ResourceData["WMO Meteorological Stations"][Select[#Country==="United States"&], "Position"]; pts=RandomGeoPosition[Entity["Country","UnitedStates"],200]; GeoGraphics[{{Red,Point/@WMOLocations},{Black,Point[pts]}},GeoRange->Entity["Country","UnitedStates"]] nearestDistances = GeoNearest[WMOLocations//Normal,pts[[1]]]; Print["Average Distance to nearest WMO Station"] Mean[GeoDistance@@@Transpose[{nearestDistances[[All,1,1]],pts[[1]]}]] Print["WMO Stations per Square Mile"] ScientificForm[Length[WMOLocations]/EntityValue[Entity["Country","UnitedStates"],"Area"]] WMOLocationsCA=Values@ResourceData["WMO Meteorological Stations"][Select[#Country==="Canada"&], "Position"]; ptsCA=RandomGeoPosition[\!\(\* NamespaceBox["LinguisticAssistant", DynamicModuleBox[{Typeset`query$$ = "Canada", Typeset`boxes$$ = TemplateBox[{"\"Canada\"", RowBox[{"Entity", "[", RowBox[{"\"Country\"", ",", "\"Canada\""}], "]"}], "\"Entity[\\\"Country\\\", \\\"Canada\\\"]\"", "\"country\""}, "Entity"], Typeset`allassumptions$$ = {}, Typeset`assumptions$$ = {}, Typeset`open$$ = {1, 2}, Typeset`querystate$$ = {"Online" -> True, "Allowed" -> True, "mparse.jsp" -> 0.549673`6.19164939839149, "Messages" -> {}}}, DynamicBox[ToBoxes[AlphaIntegration`LinguisticAssistantBoxes["", 4, Automatic, Dynamic[Typeset`query$$], Dynamic[Typeset`boxes$$], Dynamic[Typeset`allassumptions$$], Dynamic[Typeset`assumptions$$], Dynamic[Typeset`open$$], Dynamic[Typeset`querystate$$]], StandardForm], ImageSizeCache->{125., {7., 15.}}, TrackedSymbols:>{Typeset`query$$, Typeset`boxes$$, Typeset`allassumptions$$, Typeset`assumptions$$, Typeset`open$$, Typeset`querystate$$}], DynamicModuleValues:>{}, UndoTrackedVariables:>{Typeset`open$$}], BaseStyle->{"Deploy"}, DeleteWithContents->True, Editable->False, SelectWithContents->True]\),200]; GeoGraphics[{{Red,Point/@WMOLocationsCA},{Black,Point[ptsCA]}},GeoRange->\!\(\* NamespaceBox["LinguisticAssistant", DynamicModuleBox[{Typeset`query$$ = "Canada", Typeset`boxes$$ = TemplateBox[{"\"Canada\"", RowBox[{"Entity", "[", RowBox[{"\"Country\"", ",", "\"Canada\""}], "]"}], "\"Entity[\\\"Country\\\", \\\"Canada\\\"]\"", "\"country\""}, "Entity"], Typeset`allassumptions$$ = {}, Typeset`assumptions$$ = {}, Typeset`open$$ = {1, 2}, Typeset`querystate$$ = {"Online" -> True, "Allowed" -> True, "mparse.jsp" -> 0.549673`6.19164939839149, "Messages" -> {}}}, DynamicBox[ToBoxes[AlphaIntegration`LinguisticAssistantBoxes["", 4, Automatic, Dynamic[Typeset`query$$], Dynamic[Typeset`boxes$$], Dynamic[Typeset`allassumptions$$], Dynamic[Typeset`assumptions$$], Dynamic[Typeset`open$$], Dynamic[Typeset`querystate$$]], StandardForm], ImageSizeCache->{125., {7., 15.}}, TrackedSymbols:>{Typeset`query$$, Typeset`boxes$$, Typeset`allassumptions$$, Typeset`assumptions$$, Typeset`open$$, Typeset`querystate$$}], DynamicModuleValues:>{}, UndoTrackedVariables:>{Typeset`open$$}], BaseStyle->{"Deploy"}, DeleteWithContents->True, Editable->False, SelectWithContents->True]\)] nearestDistancesCA = GeoNearest[WMOLocationsCA//Normal,ptsCA[[1]]]; Print["Average Distance to nearest WMO Station"] Mean[GeoDistance@@@Transpose[{nearestDistancesCA[[All,1,1]],ptsCA[[1]]}]] Print["WMO Stations per Square Mile"] ScientificForm[Length[WMOLocationsCA]/EntityValue[Entity["Country","Canada"],"Area"]] WMOLocationsAL=Values@ResourceData["WMO Meteorological Stations"][Select[#Country==="Algeria"&], "Position"]; ptsAL=RandomGeoPosition[Entity["Country","Algeria"],100]; GeoGraphics[{{Red,Point/@WMOLocationsAL},{Black,Point[ptsAL]}},GeoRange->Entity["Country","Algeria"]] nearestDistancesAL = GeoNearest[WMOLocationsAL//Normal,ptsAL[[1]]]; Print["Average Distance to nearest WMO Station"] Mean[GeoDistance@@@Transpose[{nearestDistancesAL[[All,1,1]],ptsAL[[1]]}]] Print["WMO Stations per Square Mile"] ScientificForm[Length[WMOLocationsAL]/EntityValue[Entity["Country","Algeria"],"Area"]] WMOLocationsFR=Values@ResourceData["WMO Meteorological Stations"][Select[#Country==="France"&], "Position"]; ptsFR=RandomGeoPosition[Entity["Country","France"],100]; GeoGraphics[{{Red,Point/@WMOLocationsFR},{Black,Point[ptsFR]}},GeoRange->Entity["Country","France"]] nearestDistancesFR = GeoNearest[WMOLocationsFR//Normal,ptsFR[[1]]]; Print["Average Distance to nearest WMO Station"] Mean[GeoDistance@@@Transpose[{nearestDistancesFR[[All,1,1]],ptsFR[[1]]}]] Print["WMO Stations per Square Mile"] ScientificForm[Length[WMOLocationsFR]/EntityValue[Entity["Country","France"],"Area"]] ![enter image description here][5] ![enter image description here][6] ![enter image description here][7] ![enter image description here][8] ## Retrieving and Charting Data from the Blockchain ## This cell retrieves entries from the blockchain and charts them against a local weather station. In this example, data is retrieved from KBED which is located at the Laurence G Hanscom Field Airport about ten miles away from the personal weather station. The difference in temperature readings could be attributed to a micro-climates created my paved runways, buildings, HVAC, or other interferences. Though, in general, the temperature reading from KBED takes longer to cool down and longer to heat up. Curiously, KBED's pressure sensor either seems to be broken or has far less granularity than an AcuRite PRO+ 5-in-1 Weather Sensor. (*Collect all the Blockchain sumbissions from the weather station and chart the temperature over time*) Databin["EM6FHeXi", All]; recentHashes=Normal[Dataset[Databin["EM6FHeXi", -24]]][[All,1,-1]]; data=Dataset[BlockchainGet[recentHashes]]; times=data[[1;;All,2,2]]//Normal; temps=data[[1;;All,2,1,1,2]]//Normal; myTempsTimeSeries=TimeSeries[Transpose[{times, MapAt[ToExpression,#,1]&/@temps}]]; wmoTempsTimeSeries=TimeSeries[Transpose[{times, AirTemperatureData["KBED", times]}]]; DateListPlot[{myTempsTimeSeries,wmoTempsTimeSeries}, PlotLegends->{"Personal Weather Station","Nearest ICAO Station"}] (*Chart the weather station's Pressure*) pressure=data[[1;;All,2,1,7,2]]//Normal; myPressureTimeSeries=TimeSeries[Transpose[{times, MapAt[ToExpression,#,1]&/@pressure}]]; wmoPressureTimeSeries=TimeSeries[Transpose[{times, AirPressureData["KBED", times]}]]; DateListPlot[{myPressureTimeSeries,wmoPressureTimeSeries}, PlotLegends->{"Personal Weather Station","Nearest WMO Station"}] (*Chart the weather station's Wind Speed*) windSpeed=data[[1;;All,2,1,3,2]]//Normal; myWindTimeSeries=TimeSeries[Transpose[{times, MapAt[ToExpression,#,1]&/@windSpeed}]]; wmoWindTimeSeries=TimeSeries[Transpose[{times, WindSpeedData["KBED", times]}]]; DateListPlot[{myWindTimeSeries, wmoWindTimeSeries}, PlotLegends->{"Personal Weather Station","Nearest ICAO Station"}] **Air Temperature** ![enter image description here][9] **Pressure** ![enter image description here][10] **Wind Speed** ![enter image description here][11] ## Future Ambitions ## Future work includes plotting additional weather stations hosted by ICAO and CWOP. Plotting these datasets along with WMO stations will help determine the geographic areas with the least density of weather stations - where it would make the most sense to install the next weather station. Next steps also include: - recording multiple personal weather stations into a blockchain and databin such that each contributor gets credit for their contributions - computing weather forecasts augmented with the collected data - inserting data entries into other blockchains such as Ark and Ethereum [Notebook URL][12] [1]: https://community.wolfram.com//c/portal/getImageAttachment?filename=weathertable2.png&userId=1709975 [2]: https://www.vice.com/en_us/article/gy77wy/stop-using-third-party-weather-apps [3]: http://wolfr.am/EM6FHeXi [4]: https://community.wolfram.com//c/portal/getImageAttachment?filename=databinEntry.png&userId=1709975 [5]: https://community.wolfram.com//c/portal/getImageAttachment?filename=usaMap.png&userId=1709975 [6]: https://community.wolfram.com//c/portal/getImageAttachment?filename=canadaMap.png&userId=1709975 [7]: https://community.wolfram.com//c/portal/getImageAttachment?filename=franceMap.png&userId=1709975 [8]: https://community.wolfram.com//c/portal/getImageAttachment?filename=algeriaMap.png&userId=1709975 [9]: https://community.wolfram.com//c/portal/getImageAttachment?filename=recentTemp.png&userId=1709975 [10]: https://community.wolfram.com//c/portal/getImageAttachment?filename=recentPressure.png&userId=1709975 [11]: https://community.wolfram.com//c/portal/getImageAttachment?filename=recentWind.png&userId=1709975 [12]: https://github.com/tonykoop/WSS-2019/tree/master/Final%20Project/Final%20Submission Tony Koop 2019-07-10T19:29:09Z https://community.wolfram.com/groups/-/m/t/1729029 Sibyl Rose Paper: network specification https://github.com/DonaMedia/Sibyl-rosepaper/. [draft preview] # Sibyl-rosepaper Sibyl Rose Paper "Sibyl": Non-Computable Facts - Answer Crowdsourcing & Work Management with Blockchains, a WSS-19 Project Goal: A framework for distributed work and human resource management. Wolfram Language Function: HumanEvaluate A function to source content from distributed contributors, leveraging blockchain transactions to compensate contributors and maintain work provenance. Summary of Results An implementable architecture for distributed work and worker management has been designed. The current design leverages the most current and stable standards and protocols. Sibyl is intended to evolve through smart contracts and Wolfram Language enabled cloud infrastructure. Future Work Where The DAO promised a generalize solution for the concept of "VC". Sibyl is meant to allow a modern organization to scale exponentially, to start. - Validate Design, use Smart Contracts for internal processes - Deploy HD Wallets transparently to Yoga+ application users - Automate Smart Contract Curation and associated dApp/Web Apps Steven Clarke-Martin 2019-07-10T16:24:10Z https://community.wolfram.com/groups/-/m/t/1651797 Folks Is Data Drop limited to data elements, or can we drop the entire data sets in CSV. Want an automated data sets normalization and visualization, where we drop multiple data sets in CSV into Data Drop and then blend the data as in Google Data Studio https://datastudio.google.com/u/0/reporting/1uIvaqruCdHRGhnfn6FaLMEpeRyJxm17Y/page/chHU Visualization extracts the deeper correlations and provides a nested multiple level views - from a macro systemic view and drills down layer by layer deeper... For instance from Country Level - Hospital Spend State Level Hospital Spend County Level Hospital Level Patient Level Eventually demonstrate by a faster and elegant method the various disparities causing lack in Health equity and equality. Thanks Srinidhi Boray 2019-04-07T12:58:52Z https://community.wolfram.com/groups/-/m/t/1615623 Hi All, I have created a Databin using Data Drop, connected a [Arduino Yun Rev 2][1] to the internet, and created a functional program that queries a photoelectric sensor for a reading and posts the reading to a LCD screen and a laptop screen. Unfortunately I am unable to upload the sensor data from the Yun to Data Drop and would appreciate any insights. Wolfram's [Adruino Yun tutorial][2] suggests including the following code snippet in the Arduino sketch //upload to datadrop DatabinRealAdd(\"" <> bin["ShortID"] <> "\",\"AverageHumidity\",avg); Prior to adding this code snippet the entire program compiles and runs; after adding it the Arduino IDE highlights the newly added code snippet and gives the following error stray '\' in program This is the function that includes the code snippet void photocellReading() // Photoelectric Sensor Reading { int readPhotocell = analogRead(photoCell); if (readPhotocell < 78) // (10,000 lux)(0.00775) = 78 = Full Daylight Reading { // Show data on LCD shield screen lcd.setCursor(0, 0); lcd.print("ShadyPlant "); lcd.println(readPhotocell); lcd.println(""); delay(timerPrint); // Show data on serial port (laptop screen) Serial.print("Shady Plant: "); Serial.println(readPhotocell); Serial.println(""); delay(timerPrint); } else { // Show data on LCD shield screen lcd.setCursor(0, 0); lcd.print("SunnyPlant "); lcd.println(readPhotocell); lcd.println(""); delay(timerPrint); // Show data on serial port (laptop screen) Serial.print("Sunny Plant: "); Serial.println(readPhotocell); Serial.println(""); delay(timerPrint); // Upload data online using Wolfram Data Drop DatabinRealAdd(\"" <> bin["8 character Databin ID"] <> "\",\"PhotoCellReading\",readPhotocell); } } Editing the code snippet to read DatabinRealAdd(\"" <> bin["8 character Databin ID"] <> "\","PhotoCellReading",readPhotocell); or to read DatabinRealAdd("" <> bin["Bsnuo7NG"] <> "",\"PhotoCellReading\",readPhotocell); ... again yields the error stray '\' in program [1]: https://store.arduino.cc/usa/arduino-yun-rev-2 [2]: https://reference.wolfram.com/language/tutorial/DataDropWithArduinoYun.html#512562408 Steven Lyell 2019-02-19T04:16:51Z https://community.wolfram.com/groups/-/m/t/1509842 Is there a way to either add data to a databin anonymously, meaning with no metadata, or to delete metadata from the databin? Philip Maymin 2018-10-13T13:02:02Z