Your Privacy Settings

Our website uses cookies to personalise content, keep contents in your shopping cart and as part of the checkout experience.

Your personal information you provide will be transfered and stored as encrypted data.
You have the ability to update and remove your personal information.

You consent to our cookies if you continue to use this website.

Allow cookies for

Home
> Community
> Forums
> Read Numeric value From Excel - Page:1

Sale items. Buy now - stock going fast. Specials
You must now select Courier Delivery if you wish to receive items before Christmas.

Read Numeric value From Excel

Sreeramnewbie
1 post

Posted: 23rd Oct 2007
Hi,

I was trying to read numeric value from an excel file.I used the function "cell.getNumericCellValue()" to read the column. Some times the value is fetched correctly and some times it returns a high precision value( ie, some times the value 118.474 is fetched as 118.4739999999), while I require the exact value.
The format type of the column in the excel is "custom".

Can any one please help me on this?

Sreeram

pkBRONZE Member
Lambretta Fanatic
4,997 posts
Location: United Kingdom

Posted: 29th Oct 2007
118.4739999999 ...considering excel uses better calculations than myself I'd say that figure was most likely to be correct when 118.474 may look logically correct.

I'm no mathematician nor excel user.

Good luck.

Deamon_LlamaBRONZE Member
member
78 posts
Location: Melbourne, Australia

Posted: 29th Oct 2007
I can show mathematically that 118.4739999999 is actually equal to 118.474, but I don't think that will be particularly useful, sorry frown

---
No statements are true unless they can be proven scientifically.
---

YakumoSILVER Member
veteran
1,237 posts
Location: Oxfordshire, United Kingdom

Posted: 12th Jan 2008
are you always reading cell.getNumericCellValue into a variable with a datatype that can hold the full value? and are all the fields your reading from definitely formatted correctly?

same problem is discussed here though you havn't actually said what language you're programming/scripting in...

Blinded by Hyperlights, please donate generously grin

Mr ChutneySILVER Member
Tosser
1,712 posts
Location: Bristol,UK

Posted: 13th Jan 2008
Nor indeed why you are posting this on a poi forum?!

Similar Topics

Using the keywords [read numeric value excel] we found the following existing topics.

Forums > Read Numeric value From Excel [4 replies]

Forums > Help! > Read Numeric value From Excel

HOP Newsletter