Message Boards Message Boards

GROUPS:

[WSG21] Daily Study Group: Notebook-Based Workflows for Data Exploration

Posted 3 months ago
2031 Views
|
30 Replies
|
10 Total Likes
|

A new study group for Notebook-Based Workflows for Data Exploration begins Monday, Jan 11, 2021! A list of daily topics can be found on our Daily Study Groups page.

We will look at various "Workflows" from the Wolfram Documentation Center and see how they can be used to build our own notebook-based workflows for exploring data.

Sign up here: https://wolfr.am/StSdgBS9

30 Replies
Posted 3 months ago

Good session today! Do you want us to write questions here (as a reply) or in the general forum?

Thank you Fredrik. Please post any questions from the study group sessions here.

For generic questions on various Wolfram Language topics and other interests, please feel free to post in the related groups in the Community.

Here is a link to some of the workflows we will be looking at today: https://reference.wolfram.com/language/workflowguide/ImportingAndAnalyzingData.html

Our topic for today is "Visualizing Data". Here are some useful resources from the Wolfram Documentation Center:

Where can we find ExampleData/cities.xlsx?

FindFile["ExampleData/cities.xlsx"]

"/Applications/Mathematica.app/Contents/Documentation/English/System/ExampleData/cities.xlsx"

Posted 3 months ago

For a hyperlinked list of all Workflow Guides

workflowGuides = {$InstallationDirectory, "Documentation", $Language, "System", "WorkflowGuides"} //
  FileNameJoin // FileNames["*.nb", #] &;

workflowGuides // 
  Map[<|"Workflow Guide" -> Hyperlink[#, "paclet:workflowguide/" ~~ #] &@FileBaseName[#]|> &] //
  Sort // Dataset

For Workflows

workflows = {$InstallationDirectory, "Documentation", $Language, "System", "Workflows"} // 
  FileNameJoin // FileNames["*.nb", #] &;

workflows // 
  Map[<|"Workflow" -> Hyperlink[#, "paclet:workflow/" ~~ #] &@FileBaseName[#]|> &] //
  Sort // Dataset
Posted 3 months ago

Bless you for sharing this code; very very helpful.

Can you provide a listing all the functions as links? I don't like the current presentation as requiring more effort to use when one is disabled. I have my own ideas. ;-) The old function navigator was a good start but was removed.

Thank you!

Posted 3 months ago

Already have that (and thats tied directly to your servers not local to my harddrive); what I want to the full path of each function (the semantic context) a la the hyperlinks as data (as shown for the workflows) so I can reorganize the functions so a better GUI be made. I hate typing (not easy for me or for many other disabled folk) and want the least amount of mousing needed.

Ps. the website I see now finally provides the Info for each function if you hover over it, cool; vastly more useful.

Posted 3 months ago

Hi Andrew,

We are going a bit off-topic, but you can do the same thing for symbols

symbols = {$InstallationDirectory, "Documentation", $Language, "System", "ReferencePages", "Symbols"} //
  FileNameJoin // FileNames["*.nb", #] &;

symbols // Map[<|"Workflow" -> Hyperlink[#, "paclet:ref/" ~~ #] &@FileBaseName[#]|> &] //
  Sort // Dataset

You can use that to build a nicer interface than Dataset, maybe using autocompletion to filter from the long list.

Thanks @Rohit Namjoshi - very helpful.

Hi, How can I import the file from the cloud into a cloud notebook instead of from my machine?

For example How do I change this line?

Import["/Users/arbenk/Documents/Data Visualization Workflow Sample.m"]

Posted 3 months ago

Hi Stephen,

Replace the file path with the object's URL, e.g.

Import["https://www.wolframcloud.com/obj/5cee1f52-2173-49f6-80bc-17a532607753"]

Or if you know the path on the Wolfram Cloud

CloudImport["https://www.wolframcloud.com/obj/rohit.namjoshi/test.xlsx"]

Thanks, I got the hang of it now.

Posted 3 months ago

Just a question on the link to the Multiparadigm course ( https://www.wolfram.com/wolfram-u/multiparadigm-data-science/dealing-with-messy-data.html )

The link refers to a page with the Wolfram U logo and then after 1-2 s, the browser moves on the URL https://www.wolfram.com/?t=01

Posted 3 months ago

Seems to be an issue with "third party cookies"

Could you try this link from the Wolfram U site? https://www.wolfram.com/wolfram-u/multiparadigm-data-science/

Posted 3 months ago

I got it to work with 1) make sure that I was logged in to my Wolfram User portal account and then 2) use the URL in Edge instead of Chrome. For some of the other courses I got an error message about the "Third party cookies", tried to allow these for the site in Chrome, no success. No problem to use Edge.

Posted 3 months ago

Great example with the meteorites. Here is the timing with and without the Interpreter function for the final Manipulateenter image description here

Here are some of the links (from Stephen Wolfram's blog) I shared today about using notebooks for your data exploration workflow:

I created a notebook outline with numbered chapters with sections and subsections. I added the ResourceFunction with the NotebookOutineMenu option and the resulting outline menu items numbering are all zeros. Is there a parameter or option that I'm missing that is needed to get the numbering in the pull down menu to show properly?

The added notebook above behaves differently than the same notebook running in Mathematica. The notebook in Mathematica produces a menu outline pull down menu with the chapters, sections, and subsections shown but the numbers are all zero. The added notebook above produces the transpose error. Would should some explain what's happening there?

@Jay Morreale NotebookOutlineMenu does seem to be showing an error in a cloud notebook. I have reported it to the creator of the function.

Thank you.

Hello, During the visualisation class we were taught how to use featurespaceplot function but I could not find any information about the axes in the output as I have captured in the example shown below https://www.wolframcloud.com/obj/6ad249dd-97c2-49ee-87a0-c9d6c3728b46

What features are being extracted from the list of alphabets?

Thank you.

Yeu Wen

When you are using FeatureSpacePlot you can use options like FeatureExtractor and Method to customize the type of features being extracted from the data. However FeaatureSpacePlot does not immediately make available the extracted features.

To look at the extracted features, you could use FeatureExtract (https://reference.wolfram.com/language/ref/FeatureExtract.html) and DimesnionReduce (https://reference.wolfram.com/language/ref/DimensionReduce.html).

What FeatureSpacePlot provides is a quick and easy alternative to using FeatureExtract on your data followed by DimensionReduce (to reduce number of dimensions to 2) and then use ListPlot.

You can try the following code:

imgs = Rasterize /@ Alphabet[];
FeatureSpacePlot[imgs]
ListPlot[Thread[DimensionReduce[FeatureExtract[imgs], 2] -> imgs]]

The two visualizations may be different because we are not specifying any options in the code above and the methods picked during the two sets of operations may be different with defaults settings. You could possibly get similar results by fine tuning options (Method, FeatureExtractor, etc.) for both sets of functions.

Hello All,

Is it possible to obtain the solution to the final quiz? I am not able to get them all correct even after numerous tries.

Thank you. Yeu Wen

Hi Yeu Wen,

Sorry for the delay in getting back to you. Here is the answer key: 1. B, 2. D, 3. B, 4. D, 5. C, 6. A, 7. D, 8. A, 9. D, 10. B

Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Reply Preview
Attachments
Remove
or Discard

Group Abstract Group Abstract