When I ROUND_HALF_UP 10.12445 with scale 2, I expect to get 10.13, because 10.12445 -> 10.1245 -> 10.125 -> 10.13 But the result is 10.12 Therfore if I succesively round with scales 4, 3 and 2, I get the result that I expect: Did I miss something? Is there a way to get the result I expect directly? A…
Tag: precision
Safely convert `float` to `double` without loss of precision
I have the following head scratcher, demonstrated in jshell 11.0.12 and 17.0.1 here The same thing occurs in a simple compiled class in both versions Although 17 warns that strictfp is no longer required The JLS says this in section 5.1.2 In 14 it contained the following after the bullet list Based on my read…
How can I intentionally create random floating point / decimal precision errors in java?
My goal is to generate random numbers that all have decimal precision errors. Here are some examples of types of numbers I would like to generate: Here are strategies I have tried. parseFloat(“4.01500000000000000001”); BigDecimal.valueOf(ThreadLocalRandom.current().nextFloat()).multiply(BigDecimal…
How to declare a numerical variable in java that is to hold a digit value with a fixed length of 3 digits always.
How to declare a numerical variable in Java that is to hold a digit value with a fixed length of 3 digits always. That is if i input 0, it should be formated to 000, if i input 31 then it should be formated to 032 and if i input 100 then it should remain 100. I need this for
BigDecimal, precision and scale
I’m using BigDecimal for my numbers in my application, for example, with JPA. I did a bit of researching about the terms ‘precision’ and ‘scale’ but I don’t understand what are they exactly. Can anyone explain me the meaning of ‘precision’ and ‘scale’…
Convert Java Number to BigDecimal : best way
I am looking for the best way to convert a Number to a BigDecimal. Is this good enough? Can we lose precision with the toString() method ? Answer This is fine, remember that using the constructor of BigDecimal to declare a value can be dangerous when it’s not of type String. Consider the below… Th…
How can I handle precision error with float in Java?
I’m wondering what the best way to fix precision errors is in Java. As you can see in the following example, there are precision errors: The result displayed is: loop value: 11 20.789999 loop value: 22 41.579998 loop value: 44 83.159996 loop value: 88 166.31999 loop value: 176 332.63998 loop value: 352 …