小编Wil*_*hih的帖子

Golang big.Float 的精度问题

我遇到了 Golang big.Float 计算的一些有趣问题。

问题是

10001000100010001000100010001000100010001000100015.5533 / 1000000000000000000

= 10001000100010001000100010001000.1000100010001000155533

然而,big.Float给出了“10001000100010001000100010001000.1000100010001000155532999999999999999999999999999999999999999999999999999999999999999 9999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999 99999999999999999999999999999999999999999999999999999999999999999999997”

代码:

var prec uint = 1024 // 512
dec, _ := new(big.Float).SetPrec(prec).SetString("1000000000000000000")
f, _ := new(big.Float).SetPrec(prec).SetString("10001000100010001000100010001000100010001000100015.5533")
q := f.Quo(f, dec)

fmt.Printf("Percision: %d\n", prec)
fmt.Printf("Quotient: %s\n", q.Text('f', -1))
Run Code Online (Sandbox Code Playgroud)

结果:

Percision: 1024
Quotient: 10001000100010001000100010001000.10001000100010001555329999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999997
Run Code Online (Sandbox Code Playgroud)

更令人困惑的部分是,如果我设置 prec = 512(较小的精度),它会产生正确的结果。

Percision: 512
Quotient: 10001000100010001000100010001000.1000100010001000155533
Run Code Online (Sandbox Code Playgroud)

有人知道我的代码有什么问题或者如何配置 big.Float 以获得预期结果吗?

谢谢大家!

math biginteger go bigfloat

2
推荐指数
1
解决办法
6315
查看次数

标签 统计

bigfloat ×1

biginteger ×1

go ×1

math ×1