Group Abstract Group Abstract

Message Boards Message Boards

The Humanities and Wolfram Language: a WTC 2018 follow-up

8 Replies

Thanks for the references.

The afterward to Lakoff and Johnson's book contains a short discussion of a new viewpoint: a Neural Theory of Language. There are some references that are a bit old in such a rapidly evolving field, but I will check them out.

I think that one problem, particularly for people like me doing unfunded explorations, is that the dictionary (word list) in Wolfram Language is too wimpy for anything more involved than "bag of words" computations. I found that the first edition of the OED is out of copyright, and there are PDF scans of the 20 volumes, but extracting the words into something useful is simply too big a task for one person. (The scans are not that sharp, so the error rate would be too hight to accurately automate, in my opinion.) It would be great if Oxford University Press would license the OED to Wolfram, but I doubt that that would happen. It might be possible to cobble something analogous to the usage quotes in the dictionary by using all the out-of-copyright literature that is already in plain text, but I suspect that there would need to be expert curation.

My suspicion is that this will be best another stage in the development of AI. Great things were promised, followed by running into hardware (and possibly conceptual) limitations, which resulted in stasis until the next breakthrough. I am not sure that the current hardware can do a decent job using an 800,000 entry dictionary with the type of added information that the OED has.

The main downside to this is that people may make commercial use of the fruits of the current state of NLP and not realize its (severe) limitations.

Right now, this problem is on the back-burner for me until I can find an economical way to use a GPU to do Neural Nets on macOS.

More follow-up. I found this very informative book:

Metaphors We Live By, by George Lakoff and Mark Johnson. I think anyone interested in natural language processing will have to deal with the points raised in this book. I think that if the use of metaphor in everyday language is not handled properly, then "natural language" will become yet another technical term that means something close to the commonplace idea, but sufficiently different to render any insights generated questionable.

I have some ideas about how to move from "bag of words" analysis to something a bit more useful, but I have to test them before presenting them.

Good point, George! Coincidentally, I have just found out about another strange dysfunctionality of NLP - even more alarming to me as it is much more primitive operation. Current state of the art word embeddings cannot distinguish between synonyms and antonyms. This is perplexing to me as such ability is the basis of semantics. Some special work going in this direction but it is not a commonplace.

https://www.aclweb.org/anthology/N15-1100

http://propor2016.di.fc.ul.pt/wp-content/uploads/2016/07/BrunaThalenbergPROPORSRW2016.pdf

http://tcci.ccf.org.cn/conference/2018/papers/141.pdf

POSTED BY: Vitaliy Kaurov
Posted 7 years ago

George, I wonder how your concerns can be addressed by the Cyc Project run by Doug Lenat of Cycorp (www.cyc.com) -- the longest continuously running project in AI? Stephan and Doug worked together when they were younger. Stephan said some years ago that before Alpha was announced, he connected with Doug to say that Alpha wasn't intruding upon Cyc's turf. Doug gave a thumbs up to Alpha.

The Cyc Project's goal is to endow automated reasoning with common sense. It splits human knowledge into diverse microtheories, each equipped with the modes of reasoning, discussion, idioms, etc. of that particular area of knowledge. There's a microtheory for mathematics, religion, organizations, physics, chemistry, fantasy, etc. His experts range from historians to mathematicians to comp scientists to Airborne Rangers. I wonder how this content could be tapped by Alpha (it may be worth asking Wolfram if they've investigated any potential WL-Cyc "collaboration").

Bob, we share a common perspective on history. I've started working on a WTC2019 presentation that discusses cliometrics (the mathematical modeling of history) -- let's see if the abstract flies. As you may recall from his WTC2017 talk, Kuba Kabala (Davidson College) does textual analyses (using WL) of documents from the medieval papacy. Hopefully he'll have another blockbuster for WTC2019 (Kuba, you still have an open invitation to talk to the Washington DC-Area Mathematica Special Interest Group when it relaunches at The Catholic University of America in the Spring).

POSTED BY: Bruce Colletti

George,

Your points are well taken, especially wrt computation being used to create art, music, or literature.

My own interests, though, are to use computation as a tool to study the humanities. My K-12 experience with history was as you described, and now with some years of experience in the real world I appreciate much better the need to study the motivation behind historical events and the trajectory of events and people that led up to the event of interest.

I liken the use of computation to help inform the study of the humanities much like that of a magnifying glass, microscope, electron microscope, ... making it possible to observe biology in every greater detail. I will still use my own mind to make conjectures and draw conclusions. The Eureka! moments are rare, but all the more rewarding because I was the one connecting the dots the algorithm helped me find.

Bob

POSTED BY: Robert Nachbar
Posted 7 years ago

Interesting to see philosophy posted on a Software applications forum. I am reminded of the Chinese puzzle box analogy used by Roger Penrose which posits a group of Chinese inside a box who use a computer algorithm to pass a Turing test in English successfully even though they have no knowledge of English, and hence no understanding of the questions posed by the examiner.

To say AI understands something is false because it is merely reacting to stimuli. However I believe those reactions can become more and more sophisticated to the degree that it will eventually become indistinguishable from the reactions of a human.

POSTED BY: BJ Miller
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Reply Preview
Attachments
Remove
or Discard