Message Boards Message Boards

0
|
1248 Views
|
1 Reply
|
1 Total Likes
View groups...
Share
Share this post:

Precision of N command

Posted 11 years ago
Why N[2.3/3,40] doesn't  attempt to give a result with 40-digit precision?
POSTED BY: ga3
The number 2.3 is machine precision.  So N cannot give you more precision than you already started with.

 In[25]:= N[2.3/3, 40]
 
 
 Out[25]= 0.766667
 
 
 In[26]:= Precision[%]
 
 
Out[26]= MachinePrecision


In[27]:= Precision[2.3]


Out[27]= MachinePrecision


In[28]:= N[23/30, 40]


Out[28]= 0.7666666666666666666666666666666666666667
POSTED BY: David Reiss
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Reply Preview
Attachments
Remove
or Discard

Group Abstract Group Abstract