Group Abstract Group Abstract

Message Boards Message Boards

Analyzing Apple's NeuralHash surveillance system

Posted 4 years ago

An analysis of Apple's CSAM Detection NeuralHash Network

POSTED BY: Ghostly Rose
4 Replies
Posted 4 years ago

Hashing error is slightly better when the background color is preserved during rotation, but still consistently drops to 75-80% bit match. They probably hash rotated images to avoid this shortcoming however.

Considering two unrelated cat pictures can match with 68% bit similarity, Apple will likely have to deal with many false positives regardless. 1 in 1 Trillion error seems like utterly wrong based on their approach: neural networks are not intelligent enough to accomplish that kind of accuracy, and current NN approaches have a known sensitivity to rotation and arbitrary perspective transformations (which was one of the original sparks for the creation of alternatives like capsule nets).

POSTED BY: Ghostly Rose
Posted 4 years ago

Is there a way we could get access to the ONNX files and the original weight files? Also you might be interested in: https://blog.wolfram.com/2021/01/07/deploy-a-neural-network-to-your-ios-device-using-the-wolfram-language/

POSTED BY: Test Account
Posted 4 years ago

Apple stores the weight files on all up-to-date Apple computers in the "/System/Library/Frameworks/Vision.framework/Resources/" folder. These weights are also present on similar folder which is accessible on jailbroken Apple iOS devices. Finally, these files can be extracted from iOS disk images (discussed here: https://github.com/AsuharietYgvar/AppleNeuralHash2ONNX ).

ONNX files can be created using the shell commands in the correspondingly named section of the notebook.

I cannot upload .onnx or .zip files to this forum for some reason.

POSTED BY: Ghostly Rose
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Reply Preview
Attachments
Remove
or Discard