如何在Go中将编码转换为UTF-8？

Question

我正在开发一个项目,我需要将文本从编码(例如Windows-1256阿拉伯语)转换为UTF-8.

我怎么在Go中这样做？

Answer 1

您可以使用编码包,其中包括通过包支持Windows-1256 golang.org/x/text/encoding/charmap(在下面的示例中,导入此包并使用charmap.Windows1256而不是japanese.ShiftJIS).

这是一个简短的例子,它将日语UTF-8字符串编码为ShiftJIS编码,然后将ShiftJIS字符串解码回UTF-8.不幸的是,它在操场上不起作用,因为操场上没有"x"包.

package main

import (
    "bytes"
    "fmt"
    "io/ioutil"
    "strings"

    "golang.org/x/text/encoding/japanese"
    "golang.org/x/text/transform"
)

func main() {
    // the string we want to transform
    s := "???"
    fmt.Println(s)

    // --- Encoding: convert s from UTF-8 to ShiftJIS 
    // declare a bytes.Buffer b and an encoder which will write into this buffer
    var b bytes.Buffer
    wInUTF8 := transform.NewWriter(&b, japanese.ShiftJIS.NewEncoder())
    // encode our string
    wInUTF8.Write([]byte(s))
    wInUTF8.Close()
    // print the encoded bytes
    fmt.Printf("%#v\n", b)
    encS := b.String()
    fmt.Println(encS)

    // --- Decoding: convert encS from ShiftJIS to UTF8
    // declare a decoder which reads from the string we have just encoded
    rInUTF8 := transform.NewReader(strings.NewReader(encS), japanese.ShiftJIS.NewDecoder())
    // decode our string
    decBytes, _ := ioutil.ReadAll(rInUTF8)
    decS := string(decBytes)
    fmt.Println(decS)
}

日语StackOverflow站点上有一个更完整的示例.该文本是日文,但代码应该是不言自明的:https://ja.stackoverflow.com/questions/6120