我有这个简短版本的ADSB json数据,想将其转换为datacab列,例如Icao,Alt,Lat,Long,Sdd,Cou .....
在Alperen告诉我这样做之后
df = pd.read_json('2016-06-20-2359Z.json', lines=True),
Run Code Online (Sandbox Code Playgroud)
我可以将其加载到DataFrame中。但是,df.acList是
[{'Id':10537990,'Rcvr':1,'HasSig':False,...
名称:acList,dtype:对象
如何获取Icao,Alt,Lat,Long,Sdd,Cou数据?
“ src”:1,
“提要”:[
{
“ id”:1,
“名称”:“ ADSBexchange.com”,
“ polarPlot”:false
}
],
“ srcFeed”:1,
“ showSil”:是的,
“ showFlg”:是的,
“ showPic”:是的,
“ flgH”:20,
“ flgW”:85,
“ acList”:[
{
“ Id”:11281748,
“ Rcvr”:1,
“ HasSig”:否,
“ Icao”:“ AC2554”,
“错误”:false,
“ Reg”:“ N882AS”,
“ FSeen”:“ \ /日期(1466467166951)\ /”,
“ TSecs”:3,
“ CMsgs”:1,
“ AltT”:0,
“ Tisb”:否,
“ TrkH”:否,
“类型”:“ CRJ2”,
“ Mdl”:“ 2001
炸弹公司
CL-600-2B19“,
“ Man”:“ Bombardier”,
“ … 我在将unix时间转换为时间戳时遇到问题。
我有一个数据框,一列是PosTime。我想将其转换为Timestamp,但是它工作了一半。你能帮我吗?
scala> adsb.printSchema()
root
|-- Icao: string (nullable = true)
|-- Alt: long (nullable = true)
|-- Lat: double (nullable = true)
|-- Long: double (nullable = true)
|-- PosTime: long (nullable = true)
|-- Spd: double (nullable = true)
|-- Trak: double (nullable = true)
|-- Type: string (nullable = true)
|-- Op: string (nullable = true)
|-- Cou: string (nullable = true)
scala> adsb.show(50)
+------+------+---------+----------+-------------+-----+-----+----+--------------------+--------------------+
| Icao| Alt| Lat| Long| PosTime| Spd| Trak|Type| Op| Cou|
+------+------+---------+----------+-------------+-----+-----+----+--------------------+--------------------+
|ABECE7| …Run Code Online (Sandbox Code Playgroud) 我有一个Icao带有十六进制代码的列的DataFrame ,我想将其转换为Long数据类型。如何在Spark SQL中做到这一点?
| Icao|count|
+------+-----+
|471F8D|81350|
|471F58|79634|
|471F56|79112|
|471F86|78177|
|471F8B|75300|
|47340D|75293|
|471F83|74864|
|471F57|73815|
|471F4A|72290|
|471F5F|72133|
|40612C|69676|
Run Code Online (Sandbox Code Playgroud)