https://community.wolfram.com RSS Feed for Wolfram Community showing questions tagged with Computer Science sorted by active. https://community.wolfram.com/groups/-/m/t/3711906 Maybe the theorem has a set of measure 0 for which it fails? I have 3 nested functions, each quadratic in its inputs. A standard multi-layer linear plus logistic NN with ADAM optimizer can't seem to minimize the loss (or it gets stuck in a local minimum). I've tried varying the number of layers, and their width, but to no avail. What's going on? &[Wolfram Notebook][1] [1]: https://www.wolframcloud.com/obj/47d5251d-896e-4401-97eb-d9794b91e871 Iuval Clejan 2026-05-04T19:31:25Z https://community.wolfram.com/groups/-/m/t/401838 Hi all, As we are writing up a publication for which we used the built-in function **MorphologicalGraph**, I was wondering whether someone could tell if this function is based on a known, named algorithm so that I can also refer to the exact algorithm that lies at the basis of our findings. Thanks, Jan Jan Baetens 2014-12-04T12:01:47Z https://community.wolfram.com/groups/-/m/t/3581574 I have installed the NVIDIA CUDA Toolkit version 13.0 on my Windows 11 Pro PC. The PC is an HP Z2SFF G5 Workstation with 64 GB memory and an Intel Core i7-10700 CPU @ 2904 MHz. Windows 11 is version 10.0.26100, Build 26100. I have previously installed cupy and numba into my VS Code environment for Python development and that works just fine. I have done a fresh install of the CUDA Toolkit version 13.0 and NVIDIA driver version 581.8 on the PC. Commands like 'CUDADeviceCount[]', 'CUDAInformation[]' and 'CUDADriverVersio[]' all work correctly and without error. Executing the command 'InstallCUDA[]', however, gives the error 'Failed to find CUDA libraries'. Here's the bit of code I used for testing my installation Needs["CUDALink`"] InstallCUDA[] ![Error Message][1] The problem seem to be that the libraries (*.dll) are located in the folder C:\Brogram Files\NVIDIA GPU Toolkit\CUDA\V130\bin\x64, but Mathematica is looking for them in C:\Brogram Files\NVIDIA GPU Toolkit\CUDA\V130\bin. The Help for InstallCUDA[] says: "InstallCUDA uses heuristic methods to find the CUDA toolkit on your system." and "InstallCUDA returns a Failure object when it can not find or load the appropriate CUDA libraries." I was unsuccessful in trying to find what the heuristic actually does. I tried adding the correct folder to $Path with no effect. I tried copying the contents of the x64 folder to the bin subfolder, but this created a raft of additional errors. I tried running Mathematica as both a normal user and as system administrator. I'm sure I'm overlooking some simple solution to this issue, but will appreciate guidance from others. Thanks Pat [1]: https://community.wolfram.com//c/portal/getImageAttachment?filename=2192CUDAerrorMessagejpg.jpg&userId=531737 Pat Lane 2025-11-26T01:39:04Z https://community.wolfram.com/groups/-/m/t/506116 Hi everyone, I was just wondering if anyone knew how to call a cloud API that HAS permissions from a standalone application? I've seen some discussions about calling an API from VBA for example but in all the examples I've seen they are Public API's. How do you authentic the API call with your credentials? Thanks a lot for any help! Andrew Andrew Yule 2015-05-28T13:11:23Z https://community.wolfram.com/groups/-/m/t/3476176 why is 96717311574016^8^16 the biggest number it can compute and any number larger than that overflows? I was discussing the first 4000 digits of my expression (((96717311574016^16777216^4)^8^4)^7)^2 * 7^11. Because this expression is greater than 96717311574016^8^16 and it is going to overflow, can someone help me how to calculate the LAST ten thousand, or even MILLION digits of this expression. Do I calculate the mod of this expression? Can I even calculate the mod if its just going to overflow? Mark Raygorodsky 2025-06-08T21:05:22Z https://community.wolfram.com/groups/-/m/t/3175724 I am following [this guide][1] to try to get Python working in `ExternalEvaluate`. (on Windows 11, Mathematica 13.0). So far, I have successfully installed Python (Step 1), and the Python package manager (Step 2), and the “pyzmq” package for Python (Step 3). But I get a "Missing Dependencies" error on Step 4: ![enter image description here][2] From [this post][3], I learned that this may be because the Python library path may not be in Mathematica's default Path. So I tried using `SetEnvironment`, to no avail: ![enter image description here][4] I then use `RegisterExternalEvaluator`, but still get MissingDependencies: ![enter image description here][5] And `FindExternalEvaluators["Python"]` still shows MissingDependencies. Not sure what else to try. [1]: https://reference.wolfram.com/language/workflow/ConfigurePythonForExternalEvaluate.html [2]: https://community.wolfram.com//c/portal/getImageAttachment?filename=Screenshot2024-05-13missingdependencies.png&userId=167076 [3]: https://community.wolfram.com/groups/-/m/t/1975953 [4]: https://community.wolfram.com//c/portal/getImageAttachment?filename=6197Screenshot2024-05-13setEnvironment.png&userId=167076 [5]: https://community.wolfram.com//c/portal/getImageAttachment?filename=Screenshot2024-05-13register.png&userId=167076 Bryan Lettner 2024-05-13T23:50:08Z https://community.wolfram.com/groups/-/m/t/3398676 Hi Giulio Alessandrini, Thank you for your guidance on this code. I tested a few leaf samples, and one of them is encountering a significant error during loading. I would appreciate it if you could provide some guidance on these errors. Flora Vosoughi 2025-02-21T14:55:40Z https://community.wolfram.com/groups/-/m/t/3403892 I have joined you guys because the biggest number Wolfram Mathematica computes is 10^16 digit number, and go bigger than that and it overflows! Is there any way to compute the first 4, 000 digits of my expression 96717311574016^(8^36 * 14) * 5764801 * 7^3, since that is about 10^20 bigger than the biggest number Mathematica can compute? I know it isn't possible to see the whole number; it will take me at least BILLIONS OF YEARS to scan over that number! I just need to know how to get the first 4, 000 digits of any number bigger than 8^16, like my expression above. It's like scientific notation with a long number after the decimal. Do I use logarithms? What's the largest ever number Wolfram alpha can ever compute? This site says it computes answers to arbitrary precision. So does arbitrary in this context mean there's no limit to how big it can go? Most importantly, how come 8^16 is the biggest number Mathematica can compute and any bigger number overflows? Mark Raygorodsky 2025-03-03T20:34:53Z https://community.wolfram.com/groups/-/m/t/3413235 I apologize if my question seems redundant. There are numbers so big it exceeds the space we have on this earth. I have read up an article on it and it stated that our earth is estimated to only 10^50 atoms wide. I noticed that starting at 96717311574016^8^16 Wolfram alpha no longer computes decimal approximations; it only gives me a power of ten representation. A power of ten representation isn't useful in knowing the numbers digits to a given precision. Has it have to do the fact that we only occupy so much space on this planet? Thanks a lot for the help I may get! This may be my second to last post. Mark Raygorodsky 2025-03-10T00:57:50Z https://community.wolfram.com/groups/-/m/t/3396485 Hi everyone, I’m working on an image processing project in Mathematica to count spots on tree leaves, and I’ve written a code, but it doesn’t accurately detect the number of spots. Could anyone help or provide guidance? Thank you so much for your time and valuable input! Flora Vosoughi 2025-02-18T18:09:50Z https://community.wolfram.com/groups/-/m/t/3363816 I have an experimental dataset. Data points are of the type {w,y} where w is the frequency and y is experimental absorbance. I want to fit this data with a spectroscopic line profile using NonLinearModelfit function in Mathematica. Size of data is about 500 points and the number of parameters to be fitted around 23-28. It is taking lot of time around 7-8 hours. I cannot divide my dataset and compute parallelly because in that case there will be no consistency of the fitted parameters across the divided datasets. Then how to faster the process? Any suggestions? Rajesh Chell 2025-01-24T14:17:01Z https://community.wolfram.com/groups/-/m/t/3365621 To run the Mathematica runtime directly on the PYNQ board, you’ll have to cross-compile Wolfram libraries for ARM. Wolfram Mathematica does not natively provide ARM-compatible libraries (libWolframRTL.so) for ARM platforms such as the PYNQ board. The libraries provided by Wolfram are typically built for x86-64 Linux systems, which causes the architecture mismatch when you try to use the ARM cross-compiler (arm-linux-gnueabihf-gcc). In this, ARM-compatible libraries from Wolfram are required. Or please provide a custom solution or suggest alternatives. Vijaya Babu Panthagani 2025-01-28T13:59:01Z https://community.wolfram.com/groups/-/m/t/3356414 ##Background: The Cunningham project may be the longest ongoing computational project in history. See https://homes.cerias.purdue.edu/~ssw/cun/. As of this writing there are 21 numbers as yet unfactored from the 1987 published version of the book. These are all numbers of the form 2^n+1 for n < 1200 and 2^(2n+1) +/- 2^(n+1) + 1 for n < 600 A number of years ago a big push was made to finish all Mersenne numbers (2^n-1) for n < 1200. It would be nice to finish this last small set of composites. They were added to the tables in the early 1960's by John Selfridge and D.H. Lehmer, so have been waiting for over 60 years to get done. Attempts to factor these numbers have been made since the time of Fermat, so they have strong historical interest. ##Current status and request: A BOINC project (https://escatter11.fullerton.edu/nfs/) is currently being run that uses the Number Field Sieve to factor these numbers, but it is "running out of steam". While this sort of project is out of scope in terms of not using Wolfram Language or related, it nonetheless might appeal to some participants in this forum, especially those with amateur (or professional) interests in computational number theory. And joining the project does not presume or require factoring expertise. It is a generic BOINC project, similar to SETI at Home, Protein Folding at Home, etc. That is to say, it's a distributed crowd-sourced effort. This is a request for people to join the project to help finish these composites. This project pushes the state of the art in factoring algorithms. Robert Silverman 2025-01-13T16:56:42Z https://community.wolfram.com/groups/-/m/t/3352838 After creating a package in wolfram, i would like the call the package directly from the library without from host to executed in C. How to link ( wstp) that package in C libraries How to frane the question and give the solution How can I directly link a Wolfram Mathematica package (.m or .wl) to a C program using Wolfram Symbolic Transfer Protocol (WSTP), such that the package can be loaded and executed within the C environment without explicitly requiring the host interface? What are the steps to integrate the package into a C library and use it seamlessly? Solution 1. Package Preparation Ensure the Mathematica package is well-structured and contains the functions you want to call. For example: (* File: arithmetic.wl *) BeginPackage["Arithmetic`"] Add::usage = "Add[x, y] adds two numbers." Subtract::usage = "Subtract[x, y] subtracts the second number from the first." Begin["`Private`"] Add[x_, y_] := x + y Subtract[x_, y_] := x - y End[] EndPackage[] Save this file as arithmetic.wl or arithmetic.m. 2. Write the Wolfram Script for WSTP Create a Wolfram script (.wls) to expose the package's functions over WSTP. (* File: ArithmeticServer.wls *) Needs["Arithmetic`"] Install[LinkCreate["ArithmeticLink"]]; Add[x_, y_] := Arithmetic`Add[x, y]; Subtract[x_, y_] := Arithmetic`Subtract[x, y]; While[LinkReadyQ["ArithmeticLink"], LinkRead["ArithmeticLink"]; (* Process requests here *) ] LinkClose["ArithmeticLink"]; Run this script on the Mathematica kernel to expose the functions through WSTP. 3. Generate the WSTP Template Use the mprep tool to generate a C header file for the interface. Create a .tm file: :Begin: :Function: Add :Pattern: Add[x_Integer, y_Integer] :Arguments: { x, y } :ArgumentTypes: { Integer, Integer } :ReturnType: Integer :End: :Begin: :Function: Subtract :Pattern: Subtract[x_Integer, y_Integer] :Arguments: { x, y } :ArgumentTypes: { Integer, Integer } :ReturnType: Integer :End: Run mprep: mprep Arithmetic.tm -o Arithmetic.c 4. Write the C Program Link your Mathematica package with the generated C code using the WSTP functions. #include <wstp.h> #include <stdio.h> int main() { WSLINK link; int errorCode; // Initialize WSTP if (!WSInitialize(NULL)) { printf("Failed to initialize WSTP\n"); return 1; } // Open the link link = WSOpenString(NULL, "-linkname 'ArithmeticLink'", &errorCode); if (link == NULL || errorCode != WSEOK) { printf("Failed to open WSTP link: %d\n", errorCode); return 1; } // Example: Call the Add function WSPutFunction(link, "Add", 2); WSPutInteger(link, 5); WSPutInteger(link, 3); WSEndPacket(link); WSTestHead(link, "Integer", &errorCode); int result; WSGetInteger(link, &result); printf("Result of Add: %d\n", result); // Close the link WSClose(link); WSDeinitialize(); return 0; } 5. Compile and Run the Program Compile using gcc (or an appropriate compiler): gcc -o ArithmeticClient Arithmetic.c -lWSTP Run the Wolfram script (ArithmeticServer.wls) to initialize the WSTP link. Run the compiled C program: ./ArithmeticClient Iam getting WSTP linking problem .Could anyone guide me , how to link wstp with C code Vijaya Babu Panthagani 2025-01-08T04:04:00Z https://community.wolfram.com/groups/-/m/t/3347998 If I create a file through a program and save the data in a folder on the desktop I can import the data to be used in another program but if I turn off mathematica and reopen the program that imports the data I can no longer import it and if I can import the data, the script doesn't run perfectly, which doesn't happen when I run the program when I generate the folder data without turning off mathematica Luis Felipe Massena Misiec 2025-01-01T14:57:45Z https://community.wolfram.com/groups/-/m/t/3311941 Thanks in advance for you interest, I'm seeking advice if there are ways to speed up the computation of my simulation, without reducing accuracy. I've been producing a simulation of an SDE of the Ornstein-Uhlenbeck process on a regular simplex. In particular, I look at a simplex with $m$ number of spatial dimensions, with the stochastic process $x$ starting at a uniform random location and evolving form there a tendency mean reversion. Further, the point of reversion changes halfway through the simulation. Because of the unusual domain the best way to get at this is through simulating many replicates and averaging them together (in fact, I'm interested in a function $R(x)$ of the process). However, I've had difficulty getting the standard error of the simulation low enough to for my purposes (finding min and max values over input parameter combinations). The levers I've been playing with are (1) number of replicates, (2) the time increment of simulation, (3) the SDE simulation method (e.g. Milstein). What I'm seeking is advice on is if there are ways I can change my code to induce quicker computation, without sacrificing accuracy (e.g., reducing number of replicates makes things quicker but less accurate). Thanks again for any input: (** Computes \[CapitalEpsilon][R(X)] **) (* \[Eta],\[Kappa],m,q,T are input parameters *) (* \[Eta]: upper limit of a simplex side *) (* \[Kappa]: rate of mean reversion *) (* m: number of spatial dimensions *) (* T: time limit *) (* \[CapitalDelta]t: the time increment of the SDE simulation *) (* reps: number of replicate simulations *) \[ScriptCapitalE]R[\[Eta]_, \[Kappa]_, m_, q_, T_, \[CapitalDelta]t_ : 0.01, reps_ : 10^4] := Block[{xopt0, xopt1, F, R, x0, xs, xts, B, M, \[Sigma], \[Mu], proc, RTs, t, \[Mu]0, \[Mu]1}, (** produces random initial condition for each replicate **) x0 = Map[\[Eta]*Join[#, {1 - Total[#]}] &, RandomVariate[DirichletDistribution[ConstantArray[1, {m}]], reps]]; (** produces label of each spatial variable: X_1,X_2,...,X_m *) xs = Table[Symbol["x" <> ToString[i]], {i, m}]; xts = Map[(#[t] &), xs]; (** produces the deterministic dynamics and noise correlation \ matrices **) (* mean reversion point is called xopt - there are two because dynamics change halfway *) xopt0 = ConstantArray[\[Eta]/m, {m}]; xopt1 = Clip[If[q < 1.00, Prepend[ConstantArray[\[Eta]/m - 1/m Log[(m - 1) q/(1 - q)], {m - 1}], \[Eta]/ m + (m - 1)/m Log[(m - 1) q/(1 - q)]], Prepend[ConstantArray[0, {m - 1}], \[Eta]]], {0, \[Eta]}]; (* matrices constrain movement to simplex domain *) B[x_] := DiagonalMatrix[Map[Boole[# > 0] &, x]]; M[x_] := Total[Map[Boole[# > 0] &, x]]; (* \[Sigma] is the correlation matrix, \[Mu] the deterministic \ transition matrix *) \[Sigma] = B[xts] . (IdentityMatrix[m] - 1/M[xts]*ConstantArray[1, {m, m}] . B[xts]); \[Mu][xoptin_] := \[Sigma] . (\[Kappa] (xoptin - xts)); (* two deterministic matrices because dynamics change halfway *) \[Mu]0 = \[Mu][xopt0]; \[Mu]1 = \[Mu][xopt1]; (* provides function which random vector process X from SDE is fed \ into *) F[x_] := 1 - E^-x; R[xvec_] := q*F[xvec[[1]]] + (1 - q)/(m - 1)*(Sum[F[xvec[[i]]], {i, 2, m}]); (** simulation of replicate trajectories **) (* halfway dynamics change *) (* 'proc' takes random initial condition and produces a trajectory *) (* trajectory is fed into 'R' *) proc[x0in_] := Block[{X0, X1}, X0 = RandomFunction[ ItoProcess[{\[Mu]0, \[Sigma]}, {xs, x0in}, {t, 0.}], {0., T/ 2, \[CapitalDelta]t}, Method -> "Milstein"]; X1 = RandomFunction[ ItoProcess[{\[Mu]1, \[Sigma]}, {xs, X0["LastValues"][[1]]}, {t, 0.}], {T/2, T, \[CapitalDelta]t}, Method -> "Milstein"]; TimeSeriesMap[R, TimeSeriesInsert[X0, X1]]["ValueList"] ]; (* replicates are paralellized over random initial condition values \ *)RTs = Parallelize@Table[proc[x0[[i]]], {i, reps}]; (* expected value over time and space is result *) Mean[Flatten[RTs]] ] (* on the order of 3 minutes *) AbsoluteTiming[\[ScriptCapitalE]R[1.00, .50, 3, 1.00, 1.00]] Cameron Turner 2024-10-30T17:42:19Z https://community.wolfram.com/groups/-/m/t/3249480 I make a lot of queries that look something like... > 1.92 TB / 128 KiB The expected result is a ratio, telling me how many 128 KiB units of data can fit into 1.92TB of storage. In this case, I expect an answer of about 14.6 million. Up until recently this type of query has worked flawlessly, but when I try it today, it's not working. Does anybody know what's going on? Is there some other way I'm supposed to format this kind of query now, or is this a bug? Matthew McMullan 2024-08-16T15:48:12Z https://community.wolfram.com/groups/-/m/t/3275361 I've written the following code to extract the data I need from invoices which are in pdf format but can vary in terms of layout and terminology: (*Step 1:Prepare Training Data*) trainingDataItemDesc = { "Description" -> "SimilarString", "DESCRIPTION" -> "SimilarString", "Product Name" -> "SimilarString", "Product Details" -> "SimilarString", "Products" -> "SimilarString", "Product" -> "SimilarString", "Details" -> "SimilarString", "Desc" -> "SimilarString", "ITEM" -> "SimilarString", "Product Description" -> "SimilarString", "" -> "SimilarString", "Item Description" -> "SimilarString", "ITEMS" -> "SimilarString", "Description of Goods Sold" -> "SimilarString", "Part Number/Description" -> "SimilarString", "PRODUCT NAME" -> "SimilarString", "PRODUCT DETAILS" -> "SimilarString", "PRODUCTS" -> "SimilarString", "PRODUCT" -> "SimilarString", "DETAILS" -> "SimilarString", "DESC" -> "SimilarString", "PRODUCT DESCRIPTION" -> "SimilarString", "ITEM DESCRIPTION" -> "SimilarString", "DESCRIPTION OF GOODS SOLD" -> "SimilarString", "PART NUMBER/DESCRIPTION" -> "SimilarString", "description" -> "SimilarString", "product name" -> "SimilarString", "product details" -> "SimilarString", "products" -> "SimilarString", "product" -> "SimilarString", "details" -> "SimilarString", "desc" -> "SimilarString", "item" -> "SimilarString", "product description" -> "SimilarString", "item description" -> "SimilarString", "items" -> "SimilarString", "description of goods sold" -> "SimilarString", "part number/description" -> "SimilarString", "Description:" -> "SimilarString", "DESCRIPTION:" -> "SimilarString", "Product Name:" -> "SimilarString", "Product Details:" -> "SimilarString", "Products:" -> "SimilarString", "Product:" -> "SimilarString", "Details:" -> "SimilarString", "Desc:" -> "SimilarString", "ITEM:" -> "SimilarString", "Product Description:" -> "SimilarString", "Item Description:" -> "SimilarString", "ITEMS:" -> "SimilarString", "Description of Goods Sold:" -> "SimilarString", "Part Number/Description:" -> "SimilarString", "Total" -> "NotSimilar", "TOTAL REMITTANCE:" -> "NotSimilar", "[GBP] TOTAL" -> "NotSimilar", "Total:" -> "NotSimilar", "Grand Total:" -> "NotSimilar", "Invoice total" -> "NotSimilar", "Total VAT" -> "NotSimilar", "Total Paid" -> "NotSimilar", "Amount Due:" -> "NotSimilar", "AMOUNT (USD)" -> "NotSimilar", "Order Total" -> "NotSimilar", "" -> "NotSimilar", "Invoice Total:" -> "NotSimilar", "Gross Total" -> "NotSimilar", "Net Price (per unit)" -> "NotSimilar", "TOTAL" -> "NotSimilar", "Total paid" -> "NotSimilar", "Invoice Total" -> "NotSimilar", "TOTAL INC. VAT:" -> "NotSimilar", "Total Amount Due" -> "NotSimilar", "TOTAL:" -> "NotSimilar", "GRAND TOTAL:" -> "NotSimilar", "INVOICE TOTAL" -> "NotSimilar", "TOTAL VAT" -> "NotSimilar", "TOTAL PAID" -> "NotSimilar", "AMOUNT DUE:" -> "NotSimilar", "ORDER TOTAL" -> "NotSimilar", "INVOICE TOTAL:" -> "NotSimilar", "GROSS TOTAL" -> "NotSimilar", "NET PRICE (PER UNIT)" -> "NotSimilar", "TOTAL AMOUNT DUE" -> "NotSimilar", "total" -> "NotSimilar", "total remittance:" -> "NotSimilar", "[gbp] total" -> "NotSimilar", "total:" -> "NotSimilar", "grand total:" -> "NotSimilar", "invoice total" -> "NotSimilar", "total vat" -> "NotSimilar", "total paid" -> "NotSimilar", "amount due:" -> "NotSimilar", "amount (usd)" -> "NotSimilar", "order total" -> "NotSimilar", "invoice total:" -> "NotSimilar", "gross total" -> "NotSimilar", "net price (per unit)" -> "NotSimilar", "total inc. vat:" -> "NotSimilar", "total amount due" -> "NotSimilar", "[GBP] TOTAL:" -> "NotSimilar", "Invoice total:" -> "NotSimilar", "Total VAT:" -> "NotSimilar", "Total Paid:" -> "NotSimilar", "AMOUNT (USD):" -> "NotSimilar", "Order Total:" -> "NotSimilar", "Gross Total:" -> "NotSimilar", "Net Price (per unit):" -> "NotSimilar", "Total paid:" -> "NotSimilar", "Total Amount Due:" -> "NotSimilar"}; trainingDataSubtot = { "Subtotal" -> "SimilarString", "Nett Total:" -> "SimilarString", "COMPONENT TOTAL" -> "SimilarString", "Sub-Total:" -> "SimilarString", "Sub Total" -> "SimilarString", "Subtotal:" -> "SimilarString", "" -> "SimilarString", "Total goods ex VAT" -> "SimilarString", "Sub-Total" -> "SimilarString", "Net value of goods" -> "SimilarString", "Total Net Amount" -> "SimilarString", "Net Total:" -> "SimilarString", "Sub-total" -> "SimilarString", "Goods Value" -> "SimilarString", "Products" -> "SimilarString", "SUB-TOTAL:" -> "SimilarString", "Net Amount" -> "SimilarString", "Nett Total" -> "SimilarString", "Total Nett Goods" -> "SimilarString", "Invoice Total" -> "SimilarString", "SUBTOTAL" -> "SimilarString", "Net total" -> "SimilarString", "NETT TOTAL:" -> "SimilarString", "SUB TOTAL" -> "SimilarString", "SUBTOTAL:" -> "SimilarString", "TOTAL GOODS EX VAT" -> "SimilarString", "SUB-TOTAL" -> "SimilarString", "NET VALUE OF GOODS" -> "SimilarString", "TOTAL NET AMOUNT" -> "SimilarString", "NET TOTAL:" -> "SimilarString", "GOODS VALUE" -> "SimilarString", "PRODUCTS" -> "SimilarString", "NET AMOUNT" -> "SimilarString", "NETT TOTAL" -> "SimilarString", "TOTAL NETT GOODS" -> "SimilarString", "INVOICE TOTAL" -> "SimilarString", "NET TOTAL" -> "SimilarString", "subtotal" -> "SimilarString", "nett total:" -> "SimilarString", "component total" -> "SimilarString", "sub-total:" -> "SimilarString", "sub total" -> "SimilarString", "subtotal:" -> "SimilarString", "total goods ex vat" -> "SimilarString", "sub-total" -> "SimilarString", "net value of goods" -> "SimilarString", "total net amount" -> "SimilarString", "net total:" -> "SimilarString", "goods value" -> "SimilarString", "products" -> "SimilarString", "net amount" -> "SimilarString", "nett total" -> "SimilarString", "total nett goods" -> "SimilarString", "invoice total" -> "SimilarString", "net total" -> "SimilarString", "COMPONENT TOTAL:" -> "SimilarString", "Sub Total:" -> "SimilarString", "Total goods ex VAT:" -> "SimilarString", "Net value of goods:" -> "SimilarString", "Total Net Amount:" -> "SimilarString", "Sub-total:" -> "SimilarString", "Goods Value:" -> "SimilarString", "Products:" -> "SimilarString", "Net Amount:" -> "SimilarString", "Total Nett Goods:" -> "SimilarString", "Invoice Total:" -> "SimilarString", "Net total:" -> "SimilarString", "Total" -> "NotSimilar", "TOTAL REMITTANCE:" -> "NotSimilar", "[GBP] TOTAL" -> "NotSimilar", "Total:" -> "NotSimilar", "Grand Total:" -> "NotSimilar", "Invoice total" -> "NotSimilar", "Total VAT" -> "NotSimilar", "Total Paid" -> "NotSimilar", "Amount Due:" -> "NotSimilar", "AMOUNT (USD)" -> "NotSimilar", "Order Total" -> "NotSimilar", "" -> "NotSimilar", "Invoice Total:" -> "NotSimilar", "Gross Total" -> "NotSimilar", "Net Price (per unit)" -> "NotSimilar", "TOTAL" -> "NotSimilar", "Total paid" -> "NotSimilar", "Invoice Total" -> "NotSimilar", "TOTAL INC. VAT:" -> "NotSimilar", "Total Amount Due" -> "NotSimilar", "TOTAL:" -> "NotSimilar", "GRAND TOTAL:" -> "NotSimilar", "INVOICE TOTAL" -> "NotSimilar", "TOTAL VAT" -> "NotSimilar", "TOTAL PAID" -> "NotSimilar", "AMOUNT DUE:" -> "NotSimilar", "ORDER TOTAL" -> "NotSimilar", "INVOICE TOTAL:" -> "NotSimilar", "GROSS TOTAL" -> "NotSimilar", "NET PRICE (PER UNIT)" -> "NotSimilar", "TOTAL AMOUNT DUE" -> "NotSimilar", "total" -> "NotSimilar", "total remittance:" -> "NotSimilar", "[gbp] total" -> "NotSimilar", "total:" -> "NotSimilar", "grand total:" -> "NotSimilar", "invoice total" -> "NotSimilar", "total vat" -> "NotSimilar", "total paid" -> "NotSimilar", "amount due:" -> "NotSimilar", "amount (usd)" -> "NotSimilar", "order total" -> "NotSimilar", "invoice total:" -> "NotSimilar", "gross total" -> "NotSimilar", "net price (per unit)" -> "NotSimilar", "total inc. vat:" -> "NotSimilar", "total amount due" -> "NotSimilar", "[GBP] TOTAL:" -> "NotSimilar", "Invoice total:" -> "NotSimilar", "Total VAT:" -> "NotSimilar", "Total Paid:" -> "NotSimilar", "AMOUNT (USD):" -> "NotSimilar", "Order Total:" -> "NotSimilar", "Gross Total:" -> "NotSimilar", "Net Price (per unit):" -> "NotSimilar", "Total paid:" -> "NotSimilar", "Total Amount Due:" -> "NotSimilar"}; trainingDataVAT = { "Tax" -> "SimilarString", "VAT 20.0 - 20%:" -> "SimilarString", "TOTAL TAX" -> "SimilarString", "VAT (20%):" -> "SimilarString", "Tax:" -> "SimilarString", "" -> "SimilarString", "VAT @ 20.00%" -> "SimilarString", "VAT (20%)" -> "SimilarString", "Total Vat:" -> "SimilarString", "20 % VAT" -> "SimilarString", "Total VAT" -> "SimilarString", "VAT:" -> "SimilarString", "VAT" -> "SimilarString", "VAT Value" -> "SimilarString", "Total Tax paid" -> "SimilarString", "Total VAT Amount" -> "SimilarString", "VAT 20%:" -> "SimilarString", "VAT Amount" -> "SimilarString", "VAT Total" -> "SimilarString", "Invoice Total" -> "SimilarString", "VAT TOTAL" -> "SimilarString", "V.A.T" -> "SimilarString", "TAX" -> "SimilarString", "TAX:" -> "SimilarString", "TOTAL VAT:" -> "SimilarString", "TOTAL VAT" -> "SimilarString", "VAT VALUE" -> "SimilarString", "TOTAL TAX PAID" -> "SimilarString", "TOTAL VAT AMOUNT" -> "SimilarString", "VAT AMOUNT" -> "SimilarString", "INVOICE TOTAL" -> "SimilarString", "tax" -> "SimilarString", "vat 20.0 - 20%:" -> "SimilarString", "total tax" -> "SimilarString", "vat (20%):" -> "SimilarString", "tax:" -> "SimilarString", "vat @ 20.00%" -> "SimilarString", "vat (20%)" -> "SimilarString", "total vat:" -> "SimilarString", "20 % vat" -> "SimilarString", "total vat" -> "SimilarString", "vat:" -> "SimilarString", "vat" -> "SimilarString", "vat value" -> "SimilarString", "total tax paid" -> "SimilarString", "total vat amount" -> "SimilarString", "vat 20%:" -> "SimilarString", "vat amount" -> "SimilarString", "vat total" -> "SimilarString", "invoice total" -> "SimilarString", "v.a.t" -> "SimilarString", "TOTAL TAX:" -> "SimilarString", "VAT @ 20.00%:" -> "SimilarString", "20 % VAT:" -> "SimilarString", "Total VAT:" -> "SimilarString", "VAT Value:" -> "SimilarString", "Total Tax paid:" -> "SimilarString", "Total VAT Amount:" -> "SimilarString", "VAT Amount:" -> "SimilarString", "VAT Total:" -> "SimilarString", "Invoice Total:" -> "SimilarString", "VAT TOTAL:" -> "SimilarString", "V.A.T:" -> "SimilarString", "Subtotal" -> "NotSimilar", "Nett Total:" -> "NotSimilar", "COMPONENT TOTAL" -> "NotSimilar", "Sub-Total:" -> "NotSimilar", "Sub Total" -> "NotSimilar", "Subtotal:" -> "NotSimilar", "" -> "NotSimilar", "Total goods ex VAT" -> "NotSimilar", "Sub-Total" -> "NotSimilar", "Net value of goods" -> "NotSimilar", "Total Net Amount" -> "NotSimilar", "Net Total:" -> "NotSimilar", "Sub-total" -> "NotSimilar", "Goods Value" -> "NotSimilar", "Products" -> "NotSimilar", "SUB-TOTAL:" -> "NotSimilar", "Net Amount" -> "NotSimilar", "Nett Total" -> "NotSimilar", "Total Nett Goods" -> "NotSimilar", "Invoice Total" -> "NotSimilar", "SUBTOTAL" -> "NotSimilar", "Net total" -> "NotSimilar", "NETT TOTAL:" -> "NotSimilar", "SUB TOTAL" -> "NotSimilar", "SUBTOTAL:" -> "NotSimilar", "TOTAL GOODS EX VAT" -> "NotSimilar", "SUB-TOTAL" -> "NotSimilar", "NET VALUE OF GOODS" -> "NotSimilar", "TOTAL NET AMOUNT" -> "NotSimilar", "NET TOTAL:" -> "NotSimilar", "GOODS VALUE" -> "NotSimilar", "PRODUCTS" -> "NotSimilar", "NET AMOUNT" -> "NotSimilar", "NETT TOTAL" -> "NotSimilar", "TOTAL NETT GOODS" -> "NotSimilar", "INVOICE TOTAL" -> "NotSimilar", "NET TOTAL" -> "NotSimilar", "subtotal" -> "NotSimilar", "nett total:" -> "NotSimilar", "component total" -> "NotSimilar", "sub-total:" -> "NotSimilar", "sub total" -> "NotSimilar", "subtotal:" -> "NotSimilar", "total goods ex vat" -> "NotSimilar", "sub-total" -> "NotSimilar", "net value of goods" -> "NotSimilar", "total net amount" -> "NotSimilar", "net total:" -> "NotSimilar", "goods value" -> "NotSimilar", "products" -> "NotSimilar", "net amount" -> "NotSimilar", "nett total" -> "NotSimilar", "total nett goods" -> "NotSimilar", "invoice total" -> "NotSimilar", "net total" -> "NotSimilar", "COMPONENT TOTAL:" -> "NotSimilar", "Sub Total:" -> "NotSimilar", "Total goods ex VAT:" -> "NotSimilar", "Net value of goods:" -> "NotSimilar", "Total Net Amount:" -> "NotSimilar", "Sub-total:" -> "NotSimilar", "Goods Value:" -> "NotSimilar", "Products:" -> "NotSimilar", "Net Amount:" -> "NotSimilar", "Total Nett Goods:" -> "NotSimilar", "Invoice Total:" -> "NotSimilar", "Net total:" -> "NotSimilar"}; trainingDataTotal = { "Total" -> "SimilarString", "TOTAL REMITTANCE:" -> "SimilarString", "[GBP] TOTAL" -> "SimilarString", "Total:" -> "SimilarString", "Grand Total:" -> "SimilarString", "Invoice total" -> "SimilarString", "Total VAT" -> "SimilarString", "Total Paid" -> "SimilarString", "Amount Due:" -> "SimilarString", "AMOUNT (USD)" -> "SimilarString", "Order Total" -> "SimilarString", "" -> "SimilarString", "Invoice Total:" -> "SimilarString", "Gross Total" -> "SimilarString", "Net Price (per unit)" -> "SimilarString", "TOTAL" -> "SimilarString", "Total paid" -> "SimilarString", "Invoice Total" -> "SimilarString", "TOTAL INC. VAT:" -> "SimilarString", "Total Amount Due" -> "SimilarString", "TOTAL:" -> "SimilarString", "GRAND TOTAL:" -> "SimilarString", "INVOICE TOTAL" -> "SimilarString", "TOTAL VAT" -> "SimilarString", "TOTAL PAID" -> "SimilarString", "AMOUNT DUE:" -> "SimilarString", "ORDER TOTAL" -> "SimilarString", "INVOICE TOTAL:" -> "SimilarString", "GROSS TOTAL" -> "SimilarString", "NET PRICE (PER UNIT)" -> "SimilarString", "TOTAL AMOUNT DUE" -> "SimilarString", "total" -> "SimilarString", "total remittance:" -> "SimilarString", "[gbp] total" -> "SimilarString", "total:" -> "SimilarString", "grand total:" -> "SimilarString", "invoice total" -> "SimilarString", "total vat" -> "SimilarString", "total paid" -> "SimilarString", "amount due:" -> "SimilarString", "amount (usd)" -> "SimilarString", "order total" -> "SimilarString", "invoice total:" -> "SimilarString", "gross total" -> "SimilarString", "net price (per unit)" -> "SimilarString", "total inc. vat:" -> "SimilarString", "total amount due" -> "SimilarString", "[GBP] TOTAL:" -> "SimilarString", "Invoice total:" -> "SimilarString", "Total VAT:" -> "SimilarString", "Total Paid:" -> "SimilarString", "AMOUNT (USD):" -> "SimilarString", "Order Total:" -> "SimilarString", "Gross Total:" -> "SimilarString", "Net Price (per unit):" -> "SimilarString", "Total paid:" -> "SimilarString", "Total Amount Due:" -> "SimilarString", "Subtotal" -> "NotSimilar", "Nett Total:" -> "NotSimilar", "COMPONENT TOTAL" -> "NotSimilar", "Sub-Total:" -> "NotSimilar", "Sub Total" -> "NotSimilar", "Subtotal:" -> "NotSimilar", "" -> "NotSimilar", "Total goods ex VAT" -> "NotSimilar", "Sub-Total" -> "NotSimilar", "Net value of goods" -> "NotSimilar", "Total Net Amount" -> "NotSimilar", "Net Total:" -> "NotSimilar", "Sub-total" -> "NotSimilar", "Goods Value" -> "NotSimilar", "Products" -> "NotSimilar", "SUB-TOTAL:" -> "NotSimilar", "Net Amount" -> "NotSimilar", "Nett Total" -> "NotSimilar", "Total Nett Goods" -> "NotSimilar", "Invoice Total" -> "NotSimilar", "SUBTOTAL" -> "NotSimilar", "Net total" -> "NotSimilar", "NETT TOTAL:" -> "NotSimilar", "SUB TOTAL" -> "NotSimilar", "SUBTOTAL:" -> "NotSimilar", "TOTAL GOODS EX VAT" -> "NotSimilar", "SUB-TOTAL" -> "NotSimilar", "NET VALUE OF GOODS" -> "NotSimilar", "TOTAL NET AMOUNT" -> "NotSimilar", "NET TOTAL:" -> "NotSimilar", "GOODS VALUE" -> "NotSimilar", "PRODUCTS" -> "NotSimilar", "NET AMOUNT" -> "NotSimilar", "NETT TOTAL" -> "NotSimilar", "TOTAL NETT GOODS" -> "NotSimilar", "INVOICE TOTAL" -> "NotSimilar", "NET TOTAL" -> "NotSimilar", "subtotal" -> "NotSimilar", "nett total:" -> "NotSimilar", "component total" -> "NotSimilar", "sub-total:" -> "NotSimilar", "sub total" -> "NotSimilar", "subtotal:" -> "NotSimilar", "total goods ex vat" -> "NotSimilar", "sub-total" -> "NotSimilar", "net value of goods" -> "NotSimilar", "total net amount" -> "NotSimilar", "net total:" -> "NotSimilar", "goods value" -> "NotSimilar", "products" -> "NotSimilar", "net amount" -> "NotSimilar", "nett total" -> "NotSimilar", "total nett goods" -> "NotSimilar", "invoice total" -> "NotSimilar", "net total" -> "NotSimilar", "COMPONENT TOTAL:" -> "NotSimilar", "Sub Total:" -> "NotSimilar", "Total goods ex VAT:" -> "NotSimilar", "Net value of goods:" -> "NotSimilar", "Total Net Amount:" -> "NotSimilar", "Sub-total:" -> "NotSimilar", "Goods Value:" -> "NotSimilar", "Products:" -> "NotSimilar", "Net Amount:" -> "NotSimilar", "Total Nett Goods:" -> "NotSimilar", "Invoice Total:" -> "NotSimilar", "Net total:" -> "NotSimilar"}; (*Step 2:Train a Machine Learning Classifier*) modelItemDesc = Classify[trainingDataItemDesc]; modelSubtot = Classify[trainingDataSubtot]; modelShip = Classify[trainingDataShip]; modelVAT = Classify[trainingDataVAT]; modelTotal = Classify[trainingDataTotal]; (*testPhrase="Another Random Example"; Print["Test phrase classification: ",modelSubtot[testPhrase]];*) (*Step 1:Set Up the Word COM Interface*) extractTextFromPDFUsingPDFtoText[pdfPath_String] := Module[{outputPath, result}, outputPath = FileNameJoin[{DirectoryName[pdfPath], FileBaseName[pdfPath] <> ".txt"}]; RunProcess[{"C:\\Poppler\\Library\\bin\\pdftotext.exe", "-layout", pdfPath, outputPath}]; result = Import[outputPath, "Text"]; If[result === "", extractTextWithOCR[pdfPath], result]] (*Step 2:Determine If OCR Is Required*) requiresOCR[text_String] := StringLength[text] < 50 || StringMatchQ[text, RegularExpression["[^a-zA-Z0-9]+"], IgnoreCase -> True] (*Step 3:OCR Extraction Function*) extractTextWithOCR[filename_String] := Module[{pages, ocrText}, (*Try to import the PDF as individual images*) pages = Import[filename, {"PDF", "Pages"}]; (*If import fails,return a failure message*) If[pages === $Failed, Return["$Failed"]]; (*Apply OCR to each page*)ocrText = TextRecognize /@ pages; (*Combine the recognized text from all pages*)StringJoin[ocrText]] (*Step 4:Combined Text Extraction Function*) extractTextFromPDF[filename_String] := Module[{text},(*First,try to extract text using Microsoft Word*) Print[filename]; text = Quiet[Check[extractTextFromPDFUsingPDFtoText[filename], ""]]; (*If the extracted text is empty or looks like gibberish,apply OCR*) If[requiresOCR[text], Print["Requires OCR"]; text = extractTextWithOCR[filename]]; text] (*Step 5:Search through all subfolders in a folder and extract \ all.pdf filenames*) getAllPDFs[folder_String] := FileNames["*.pdf", folder, Infinity]; (*Specify the training and main folders where the PDFs are located*) mainFolder = "Z:\\Shared\\03 - Operations\\06 - Supply Chain\\Invoice Data \ Extraction\\Test"; Print["Getting a list of all PDF files in the folder and its \ subfolders..."]; (*Get a list of all PDF files in the folder and its subfolders*) pdfFiles = getAllPDFs[mainFolder]; (*Step 5:Initialize a list to store the first entries in \ extractedNumbersSubtot for each file*) firstEntriesItemDesc = {}; firstEntriesSubtot = {}; firstEntriesShip = {}; firstEntriesVAT = {}; firstEntriesTotal = {}; (*Step 6:Process each file in the folder*) Do[ (*Load the file content*) invoiceText = extractTextFromPDF[pdfFiles[[i]]]; (*Step 4: Find positionsSubtot of phrases in the file content that match \ similar strings*) allPositionsItemDesc = {}; allPositionsSubtot = {}; allPositionsShip = {}; allPositionsVAT = {}; allPositionsTotal = {}; Do[ (*Find positionsItemDesc of the current phrase in the file content*) positionsItemDesc = StringPosition[invoiceText, phrase]; (*Classify the phrase if it's found in the text*) If[Length[positionsItemDesc] > 0 && modelItemDesc[phrase] === "SimilarString", (*Add all positionsItemDesc of this phrase to the list*) allPositionsItemDesc = Join[allPositionsItemDesc, positionsItemDesc] ], {phrase, Keys[trainingDataItemDesc]} ]; Print[allPositionsItemDesc]; Do[ (*Find positionsSubtot of the current phrase in the file content*) positionsSubtot = StringPosition[invoiceText, phrase]; (*Classify the phrase if it's found in the text*) If[Length[positionsSubtot] > 0 && modelSubtot[phrase] === "SimilarString", (*Add all positionsSubtot of this phrase to the list*) allPositionsSubtot = Join[allPositionsSubtot, positionsSubtot] ], {phrase, Keys[trainingDataSubtot]} ]; Do[ (*Find positionsSubtot of the current phrase in the file content*) positionsShip = StringPosition[invoiceText, phrase]; (*Classify the phrase if it's found in the text*) If[Length[positionsShip] > 0 && modelShip[phrase] === "SimilarString", (*Add all positionsSubtot of this phrase to the list*) allPositionsShip = Join[allPositionsShip, positionsShip] ], {phrase, Keys[trainingDataShip]} ]; Do[ (*Find positionsVAT of the current phrase in the file content*) positionsVAT = StringPosition[invoiceText, phrase]; (*Classify the phrase if it's found in the text*) If[Length[positionsVAT] > 0 && modelVAT[phrase] === "SimilarString", (*Add all positionsVAT of this phrase to the list*) allPositionsVAT = Join[allPositionsVAT, positionsVAT] ], {phrase, Keys[trainingDataVAT]} ]; Do[ (*Find positionsSubtot of the current phrase in the file content*) positionsTotal = StringPosition[invoiceText, phrase]; (*Classify the phrase if it's found in the text*) If[Length[positionsTotal] > 0 && modelTotal[phrase] === "SimilarString", (*Add all positionsSubtot of this phrase to the list*) allPositionsTotal = Join[allPositionsTotal, positionsTotal] ], {phrase, Keys[trainingDataTotal]} ]; (*Step 4:Extract Numbers Next to Similar Strings*) allItemDescriptions = {}; itemDescriptions = {}; extractedNumbersSubtot = {}; extractedNumbersShip = {}; extractedNumbersVAT = {}; extractedNumbersTotal = {}; numberPattern = RegularExpression["\\d{1,3}(,\\d{3})*(\\.\\d+)?"]; Do[ (*Print["positionsItemDesc dims = ",Dimensions[ positionsItemDesc]];*) If[ Dimensions[positionsItemDesc] =!= {0}, pos = Flatten[positionsItemDesc][[2]];(*Get the end positionsItemDesc \ of the match*) (*Extract lines of text directly below the item description \ header*) itemLines = StringSplit[StringDrop[invoiceText, pos], "\n"]; Print["itemLines Dims = ", Dimensions[itemLines]]; Print["Length[itemLines] = ", Length[itemLines]]; Print["Min[Length[itemLines]] = ", Min[Length[itemLines]]]; (*Ensure we handle empty lines*) itemIndex = 1; qtyIndex = 1; (*Match the lines that are under the headers and collect them*) Do[ If[StringLength[itemLines[[i]]] > 0, Print["i = ", i]; itemLine = StringTrim[itemLines[[i]]]; Print["itemLine = ", itemLine]; AppendTo[itemDescriptions, itemLine]; ], {i, 1, Min[Length[itemLines]]}] ], {positionsItemDesc, allPositionsItemDesc} ]; Do[ (*Print["positionSubtot dims = ",Dimensions[positionSubtot]];*) If[ Dimensions[positionSubtot] =!= {0}, pos = Flatten[positionSubtot][[2]];(*Get the end positionSubtot of the \ match*) (*Extract the text after the similar string's positionSubtot*) afterText = StringDrop[invoiceText, pos]; (*Find the first number following the similar string*) number = StringCases[afterText, numberPattern, 1]; (*If a number is found,add it to the list of extracted numbers*) If[number =!= {}, AppendTo[extractedNumbersSubtot, number[[1]]] (*Print["No number found after positionSubtot: ",pos]*) ]; ], {positionSubtot, allPositionsSubtot} ]; Do[ If[ Dimensions[positionShip] =!= {0}, pos = Flatten[positionShip][[2]];(*Get the end positionShip of the \ match*) (*Extract the text after the similar string's positionShip*) afterText = StringDrop[invoiceText, pos]; (*Find the first number following the similar string*) number = StringCases[afterText, numberPattern, 1]; (*If a number is found,add it to the list of extracted numbers*) If[number =!= {}, AppendTo[extractedNumbersShip, number[[1]]] (*Print["No number found after positionShip: ",pos]*) ]; ], {positionShip, allPositionsShip} ]; Do[ If[ Dimensions[positionVAT] =!= {0}, pos = Flatten[positionVAT][[2]];(*Get the end positionVAT of the match*) \ (*Extract the text after the similar string's positionVAT*) afterText = StringDrop[invoiceText, pos]; (*Find the first number following the similar string*) number = StringCases[afterText, numberPattern, 1]; (*If a number is found,add it to the list of extracted numbers*) If[number =!= {}, AppendTo[extractedNumbersVAT, number[[1]]] (*Print["No number found after positionVAT: ",pos]*) ]; ], {positionVAT, allPositionsVAT} ]; Do[ If[ Dimensions[positionTotal] =!= {0}, pos = Flatten[positionTotal][[2]];(*Get the end positionTotal of the \ match*) (*Extract the text after the similar string's positionTotal*) afterText = StringDrop[invoiceText, pos]; (*Find the first number following the similar string*) number = StringCases[afterText, numberPattern, 1]; (*If a number is found,add it to the list of extracted numbers*) If[number =!= {}, AppendTo[extractedNumbersTotal, number[[1]]] (*Print["No number found after positionSubtot: ",pos]*) ]; ], {positionTotal, allPositionsTotal} ]; (*Step 6: Flatten the list to handle any nested structure and get the first \ number*) firstExtractedNumberSubtot = If[Length[extractedNumbersSubtot] > 0, Flatten[extractedNumbersSubtot][[1]], "No numbers found"]; firstExtractedNumberShip = If[Length[extractedNumbersShip] > 0, Flatten[extractedNumbersShip][[1]], "No numbers found"]; firstExtractedNumberVAT = If[Length[extractedNumbersVAT] > 0, Flatten[extractedNumbersVAT][[1]], "No numbers found"]; firstExtractedNumberTotal = If[Length[extractedNumbersTotal] > 0, Flatten[extractedNumbersTotal][[1]], "No numbers found"]; (*Step 10:Add the result to the firstEntriesSubtot list*) AppendTo[allItemDescriptions, Flatten[itemDescriptions]]; AppendTo[firstEntriesSubtot, firstExtractedNumberSubtot]; AppendTo[firstEntriesShip, firstExtractedNumberShip]; AppendTo[firstEntriesVAT, firstExtractedNumberVAT]; AppendTo[firstEntriesTotal, firstExtractedNumberTotal], {i, Length[pdfFiles]} ]; (*Final output:List of first extracted numbers for each file*) Print["All item descriptions for each file: ", allItemDescriptions]; Print["First entries in extractedNumbersSubtot for each file: ", firstEntriesSubtot]; Print["First entries in extractedNumbersShip for each file: ", firstEntriesShip]; Print["First entries in extractedNumbersShip for each file: ", firstEntriesVAT]; Print["First entries in extractedNumbersTotal for each file: ", firstEntriesTotal]; The code is working well for the search strings which have the desired corresponding data to their right (trainingDataShip, trainingDataVAT, trainingDataTotal). The problems arise for the tabulated items where the desired data are below the search string headers (trainingDataItemDesc). After the invoices are converted to text format, the tables are lost so it is then not possible to extract all the data in the table cells below each header. How to go about this? Archie Watts-Farmer 2024-09-17T05:43:06Z https://community.wolfram.com/groups/-/m/t/3256765 I am modeling distributed computation using Wolfram Physics project. I have actors with memory, which compute their state and send messages to each other. All of this represented by a directed graph. We can't know for sure in which order events gonna happen, and Wolfram Multiway System does perfect job simulating all possibilities, and providing states graph. However, my distributed system uses timers. Even though messages can be lost and reordered, I assume that timers **always** work for each actor. However, `MultiwaySystem` tries to apply all rules, and produce all kinds of possible states, even scenarios when timer event didn't happen. I would like to filter out such branches of state evolution, otherwise state graph gonna be too cluttered. How do I do that? I came to conclusion that there are two options: 1. Filter out resulting graph. Look at each state. If at least one of the possible applied rules is a timer rule, then disregard all others. That would require some additional filtering of the resulting graph. 2. Find a way to set priority for rules. If there is at least one priority rule that can be applied, apply only it (timer rule). Disregard others. Second options looks cleaner. I found that there is some kind of **selection function** that is used in Wolfram MultiwaySystem: https://resources.wolframcloud.com/FunctionRepository/resources/MultiwayFunctionSystem/. However, it doesn't seems like available options would suit me. Do you have any ideas how I could approach this problem? Vladimir Gordeev 2024-08-26T15:03:47Z https://community.wolfram.com/groups/-/m/t/3248209 Hello, dear forum members, I have a question that I've been struggling with for some time, and despite extensive searching, I haven't been able to find an answer or identify the error. I’m working with the discrete Fourier transform to solve the one- and two-dimensional Schrödinger equation using the split-operator method. This involves splitting the Hamiltonian into kinetic and potential parts. As long as the time steps are sufficiently small, the split-operator method is generally a suitable approach for determining the discrete wave function. In the one-dimensional case, this method works very well compared to others (e.g., Crank-Nicolson, see attached file). However, I’m encountering issues in the two-dimensional case, where I'm not obtaining the expected approximate wave function. I believe the error lies in the transformation to momentum space or I may have overlooked something basic. In my example, a free wave packet with momentum k in the y-direction splits into two parts after a few time steps, which doesn't seem correct. Could someone please help me with this issue? The example is taken from: J. M. Feagin, Quantum Methods with Mathematica, New York, TELOS/Springer-Verlag, 1994. Thank you in advance! TDFourier2D[timesteps_, potheight_, ellip_] := Module[{NP, L, dx, dt, kx, ky, x0, y0, xmax, xmin, ymax, ymin, kxmax, kymax, \[Rho], TimeEnd, psi, K3, nt}, NP = 100; (* netpoints *); L = 1; dx = L/(NP - 1); dt = 1/20 dx^2; TimeEnd = timesteps; \[Rho] = 0.16; (* initial width *) x0 = 0.0 ; (* initial position *) y0 = 0.0; (* initial position *) kx = 0 ;(* wave number x *) ky = 50; (* wave number y *) xmax = 1; (* dimension of the box *) xmin = -1; (* dimension of the box *) ymax = 1; (* dimension of the box *) ymin = -1; (* dimension of the box *) kxmax = N[Pi/dx]; (* momentum lattice x-direction*); kymax = N[Pi/dx]; psi3[0] = Array[1/(\[Rho] Sqrt[Pi]) Exp[-I kx #1 - (#1 - x0)^2/(2 \[Rho]^2)]* Exp[-I ky #2 - (#2 - y0)^2/(2 \[Rho]^2)] &, {NP, NP}, {{xmin, xmax}, {ymin, ymax}}] // Quiet; K3 = Array[ 1/2 #1^2 + 1/2 #2^2 &, {NP, NP}, {{-kxmax, kxmax}, {-kymax, kymax}}]; V3 = Array[ potheight/2 #1^2 + ellip*potheight/2 #2^2 &, {NP, NP}, {{xmin, xmax}, {ymin, ymax}}]; UV[dt] = Exp[-I V3 dt]; UK[dt] = Exp[-I K3 dt]; U[dt_]@psi_ := UV[dt]*InverseFourier[UK[dt]*Fourier[psi]]; psi3[nt_, psi0_] := Nest[U[dt][#] &, psi0, nt]; Do[psi3[nt] = psi3[1, psi3[nt - 1]], {nt, 1, TimeEnd, 1}]; ] ellipticalform = 0.2; (*elliptical form from from > 0 and <= 1; 1=cylindrical*) TimeEnd = 160; (* timesteps 10 to 150 *) potheight = 0; (*potential height, free particle *) (TDFourier2D[TimeEnd, potheight, ellipticalform]) // AbsoluteTiming graphTable1 = GraphicsGrid[ Partition[ Table[Labeled[ ListDensityPlot[Abs[psi3[i]], Axes -> True, PlotRange -> All, ColorFunction -> "SunsetColors", PerformanceGoal -> "Quality"], {"x", "y"}, {Left, Top}, RotateLabel -> True], {i, 1, TimeEnd, TimeEnd/4}], 2], Frame -> All, ImageSize -> 400] ![enter image description here][1] [1]: https://community.wolfram.com//c/portal/getImageAttachment?filename=DiscreteFourier2DAug14.gif&userId=73791 Klaus von Bloh 2024-08-14T07:32:55Z