Group Abstract Group Abstract

Message Boards Message Boards

Large data sets and 3D plots

I have a 2.4GB file containing xyz and RGB values from a laser scan survey. I want to bring it into Mathematica and plot in 3D, draw sections etc. I am aware that the data set is huge and can cut it down by sampling the data or by just plotting parts of the survey at one time. However, I first need to get the data into Mathematica and this is taking forever. It is currently in a .dat format. Would another format be quicker? or are there any tips to speed the process up? I can open the file in a text editor ok. Once I get it into Mathematica are there any tips as to how to deal with it e.g. what is the largest practical size data file for plotting at 3D etc.? Would the file take too long to sort? At the moment the data looks rather random which makes abstracting parts of it rather tedious. Any help would be welcome. I am running on an iMac with 16GB of Ram and a 3.4 GHz I7 processor

POSTED BY: Malcolm Woodruff
6 Replies

I have resampled again and got down to 50,000 points which it could handle, with some crashes. Strangely though, I was able to rotate the view quite well once it was formed. Thanks for your help.

POSTED BY: Malcolm Woodruff

Interpolating this to get a surface (that is what listplot3d does, but listpointplot3d doesn't) is quite complicated and takes a lot of time with millions of points, i'm not sure if Mathematica will be able to handle it. Interpolating your data on a rectangular grid will make plotting this possible, i guess you don't really need 48 million datapoints to visualize your surface? right? i gues 10^4-10^5 should be enough to get an idea of what the data looks like...

POSTED BY: Sander Huisman

Unfortunately, the x and y coordinates seem to be at random rather than on a regular grid.

POSTED BY: Malcolm Woodruff

Hi Malcolm,

is your data on a regular grid? if yes: no do no supply the x and y data per point, rather just give an array of heights, and then DataRange to set the x and y values. If you supply x,y,z triplets it will do so-called delaunay triangulation on all your point which is very slow...

--SH

POSTED BY: Sander Huisman
POSTED BY: Malcolm Woodruff
POSTED BY: Sander Huisman
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Reply Preview
Attachments
Remove
or Discard