You sent me your data file and the example notebook and I took a look at them. The reason why it appears that your data columns are appended is that you are looking at the result using TableForm. Remember that your original data is a rectangular array--which is a list of lists, each of equal length. When you then remove your dashed strings using any of my methods above, the result is a non-rectangular array. The lists in the outermost list each may have a different length. When you use TableForm to display this on screen each such list (a "row" in the TableForm display) is left justified. However, this is not showing the column structure... it is just showing what is in each row. (In fact, by left justifying the display of the ragged array of data, TableForm is indeed showing the correct index structure that you would need to use if you were using the Part function.) Since the array is no longer rectangular, the meaning of a column is ambiguous relative to original rectangular data array since the information on which column any item came from is lost. Here is a simple example of a rectangular array with elements that we wish to remove.

test={{a, b, c}, {1, "XXX",2}, {e, f, g}, {"XXX",3,"XXX"}}

When one shows it using TableForm its rectangular structure is clear

TableForm[test]

Now remove the "XXX" strings:

test1 = test /. "XXX" -> Sequence[]

Which gives the following non-rectangular array (and where the information on which column of the original array each element came from is lost):

{{a, b, c}, {1, 2}, {e, f, g}, {3}}

And here is how this looks when one uses TableForm on it

TableForm[test1]

For small arrays this behavior is pretty clear. But in your case you had very long rows and so the ragged righthand side was not visible on your screen. You would have had to scroll the cell very far to the right to see this hint as to what was at the root of your concern.

If you want to retain the rectangular form of your array so that you can then use it in matrix calculations, the approach to removing the stringified dashs sequences would be to replace them by an appropriate number.

Is the list that you obtain when it is imported into Mathematica this,

{{1,2,3,---},{4,5,---},{---,---,---},{7,8,9,10,---}}

or is it this:

{{1,2,3,"---"},{4,5,"---"},{"---","---","---"},{7,8,9,10,"---"}}

I.e., are the dashes imported as a string of dashes? Without them being strings, the expressions (of 3 dashes in a row) are not syntactically valid. So I will assume that they appear as strings. If so then the following will work for you:

In[1]:= test = {{1, 2, 3, "---"}, {4, 5, "---"}, {"---", "---", "---"}, {7, 8, 9, 10, "---"}}

In[2]:= DeleteCases[test /. "---" -> Sequence[], {}, Infinity]

Out[2]= {{1, 2, 3}, {4, 5}, {7, 8, 9, 10}}

Another way to do it might be

In[3]:= DeleteCases[DeleteCases[test, "---", Infinity], {}, Infinity]

Out[3]= {{1, 2, 3}, {4, 5}, {7, 8, 9, 10}}

And here's another....

In[4]:= (test /. "---" -> Sequence[]) /. {} -> Sequence[]

Out[4]= {{1, 2, 3}, {4, 5}, {7, 8, 9, 10}}

Of course! I feel silly for not realizing it sooner. TableForm had me thinking that the data was in columns when rows where the more accurate way to think about it. Transposing the original array before using the DeleteCases function has everything working perfectly now. Thanks again David for all your help!

Chris, that is some useful information that I will definitely use in the future.

Best regards,

Mike.

Hmmmm... it's hard to say without an example. It is possible that the import from the text file is creating a data structure that is somewhat different from what you are expecting. Does the issue happen with all 3 approaches that I suggested? And, if so, does it happen in the same way? How large is the file that shows the problem? If it is email-able (less than 5 meg) then email it to the address that is posted on the "contact" section of my website (found from clicking on my name here).

By the way, the reason why you may have thought that the three dashes were not strings is that string characters (the quotation marks) are by default suppressed in output cells. So if you execute this in an input cell

"I am a string"

The output cell will look like this

I am a string