Message Boards Message Boards

[WSG21] Daily Study Group: Notebook-Based Workflows for Data Exploration

A new study group for Notebook-Based Workflows for Data Exploration begins Monday, Jan 11, 2021! A list of daily topics can be found on our Daily Study Groups page.

We will look at various "Workflows" from the Wolfram Documentation Center and see how they can be used to build our own notebook-based workflows for exploring data.

Sign up here: https://wolfr.am/StSdgBS9
POSTED BY: Abrita Chakravarty
30 Replies
Sort By:

Hello All,

Is it possible to obtain the solution to the final quiz? I am not able to get them all correct even after numerous tries.

Thank you. Yeu Wen
POSTED BY: Universal Simplexity

[WSG21] Daily Study Group: Notebook-Based Workflows for Data Exploration
POSTED BY: Abrita Chakravarty

Hello, During the visualisation class we were taught how to use featurespaceplot function but I could not find any information about the axes in the output as I have captured in the example shown below https://www.wolframcloud.com/obj/6ad249dd-97c2-49ee-87a0-c9d6c3728b46

What features are being extracted from the list of alphabets?

Thank you.

Yeu Wen
POSTED BY: Universal Simplexity

When you are using FeatureSpacePlot you can use options like FeatureExtractor and Method to customize the type of features being extracted from the data. However FeaatureSpacePlot does not immediately make available the extracted features.

To look at the extracted features, you could use FeatureExtract (https://reference.wolfram.com/language/ref/FeatureExtract.html) and DimesnionReduce (https://reference.wolfram.com/language/ref/DimensionReduce.html).

What FeatureSpacePlot provides is a quick and easy alternative to using FeatureExtract on your data followed by DimensionReduce (to reduce number of dimensions to 2) and then use ListPlot.

You can try the following code:

imgs = Rasterize /@ Alphabet[];
FeatureSpacePlot[imgs]
ListPlot[Thread[DimensionReduce[FeatureExtract[imgs], 2] -> imgs]]

The two visualizations may be different because we are not specifying any options in the code above and the methods picked during the two sets of operations may be different with defaults settings. You could possibly get similar results by fine tuning options (Method, FeatureExtractor, etc.) for both sets of functions.
POSTED BY: Abrita Chakravarty

I created a notebook outline with numbered chapters with sections and subsections. I added the ResourceFunction with the NotebookOutineMenu option and the resulting outline menu items numbering are all zeros. Is there a parameter or option that I'm missing that is needed to get the numbering in the pull down menu to show properly?
POSTED BY: Jay Morreale

The added notebook above behaves differently than the same notebook running in Mathematica. The notebook in Mathematica produces a menu outline pull down menu with the chapters, sections, and subsections shown but the numbers are all zero. The added notebook above produces the transpose error. Would should some explain what's happening there?
POSTED BY: Jay Morreale

@Jay Morreale NotebookOutlineMenu does seem to be showing an error in a cloud notebook. I have reported it to the creator of the function.

POSTED BY: Abrita Chakravarty

Thank you.
POSTED BY: Jay Morreale

Here are some of the links (from Stephen Wolfram's blog) I shared today about using notebooks for your data exploration workflow:
POSTED BY: Abrita Chakravarty

Great example with the meteorites. Here is the timing with and without the Interpreter function for the final Manipulateenter image description here
POSTED BY: Fredrik Doberl

Just a question on the link to the Multiparadigm course ( https://www.wolfram.com/wolfram-u/multiparadigm-data-science/dealing-with-messy-data.html )

The link refers to a page with the Wolfram U logo and then after 1-2 s, the browser moves on the URL https://www.wolfram.com/?t=01
POSTED BY: Fredrik Doberl

Seems to be an issue with "third party cookies"
POSTED BY: Fredrik Doberl

Could you try this link from the Wolfram U site? https://www.wolfram.com/wolfram-u/multiparadigm-data-science/
POSTED BY: Abrita Chakravarty

I got it to work with 1) make sure that I was logged in to my Wolfram User portal account and then 2) use the URL in Edge instead of Chrome. For some of the other courses I got an error message about the "Third party cookies", tried to allow these for the site in Chrome, no success. No problem to use Edge.

POSTED BY: Fredrik Doberl

Thanks, I got the hang of it now.

POSTED BY: Stephen Maharaj

Hi, How can I import the file from the cloud into a cloud notebook instead of from my machine?

For example How do I change this line?

Import["/Users/arbenk/Documents/Data Visualization Workflow Sample.m"]
POSTED BY: Stephen Maharaj
Rohit Namjoshi
Rohit Namjoshi
Posted 4 years ago

Hi Stephen,

Replace the file path with the object's URL, e.g.

Import["https://www.wolframcloud.com/obj/5cee1f52-2173-49f6-80bc-17a532607753"]

Or if you know the path on the Wolfram Cloud

CloudImport["https://www.wolframcloud.com/obj/rohit.namjoshi/test.xlsx"]
POSTED BY: Rohit Namjoshi

Thanks @Rohit Namjoshi - very helpful.
POSTED BY: Abrita Chakravarty
Rohit Namjoshi
Rohit Namjoshi
Posted 4 years ago

For a hyperlinked list of all Workflow Guides

workflowGuides = {$InstallationDirectory, "Documentation", $Language, "System", "WorkflowGuides"} //
  FileNameJoin // FileNames["*.nb", #] &;

workflowGuides // 
  Map[<|"Workflow Guide" -> Hyperlink[#, "paclet:workflowguide/" ~~ #] &@FileBaseName[#]|> &] //
  Sort // Dataset

For Workflows

workflows = {$InstallationDirectory, "Documentation", $Language, "System", "Workflows"} // 
  FileNameJoin // FileNames["*.nb", #] &;

workflows // 
  Map[<|"Workflow" -> Hyperlink[#, "paclet:workflow/" ~~ #] &@FileBaseName[#]|> &] //
  Sort // Dataset
POSTED BY: Rohit Namjoshi
Andrew Meit
Andrew Meit
Posted 4 years ago

Bless you for sharing this code; very very helpful.

Can you provide a listing all the functions as links? I don't like the current presentation as requiring more effort to use when one is disabled. I have my own ideas. ;-) The old function navigator was a good start but was removed.

Thank you!
POSTED BY: Andrew Meit

We do have this: https://reference.wolfram.com/language/guide/AlphabeticalListing
POSTED BY: Abrita Chakravarty
Andrew Meit
Andrew Meit
Posted 4 years ago

Already have that (and thats tied directly to your servers not local to my harddrive); what I want to the full path of each function (the semantic context) a la the hyperlinks as data (as shown for the workflows) so I can reorganize the functions so a better GUI be made. I hate typing (not easy for me or for many other disabled folk) and want the least amount of mousing needed.

Ps. the website I see now finally provides the Info for each function if you hover over it, cool; vastly more useful.
POSTED BY: Andrew Meit
Rohit Namjoshi
Rohit Namjoshi
Posted 4 years ago

Hi Andrew,

We are going a bit off-topic, but you can do the same thing for symbols

symbols = {$InstallationDirectory, "Documentation", $Language, "System", "ReferencePages", "Symbols"} //
  FileNameJoin // FileNames["*.nb", #] &;

symbols // Map[<|"Workflow" -> Hyperlink[#, "paclet:ref/" ~~ #] &@FileBaseName[#]|> &] //
  Sort // Dataset

You can use that to build a nicer interface than Dataset, maybe using autocompletion to filter from the long list.
POSTED BY: Rohit Namjoshi

Our topic for today is "Visualizing Data". Here are some useful resources from the Wolfram Documentation Center:
POSTED BY: Abrita Chakravarty

Where can we find ExampleData/cities.xlsx?
POSTED BY: Jay Morreale 
FindFile["ExampleData/cities.xlsx"]

"/Applications/Mathematica.app/Contents/Documentation/English/System/ExampleData/cities.xlsx"
POSTED BY: Abrita Chakravarty

Here is a link to some of the workflows we will be looking at today: https://reference.wolfram.com/language/workflowguide/ImportingAndAnalyzingData.html
POSTED BY: Abrita Chakravarty

Here are the links to some of the workflows we looked at today:
POSTED BY: Abrita Chakravarty

Thank you Fredrik. Please post any questions from the study group sessions here.

For generic questions on various Wolfram Language topics and other interests, please feel free to post in the related groups in the Community.
POSTED BY: Abrita Chakravarty

Good session today! Do you want us to write questions here (as a reply) or in the general forum?

POSTED BY: Fredrik Doberl
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Tag limit exceeded
Note: Only the first five people you tag will receive an email notification; the other tagged names will appear as links to their profiles.
Reply Preview
Attachments
Remove
or Discard

Group Abstract Group Abstract