Ant*_*ton 5 android audiotrack mediacodec
当一起使用AudioTrack和MediaSync时,我遇到了一个严重的内存泄漏问题。在我看来,问题在于AudioTrack不会释放某些本机资源。结果,该应用只能运行几次,此后,由于不再有可用的曲目,因此无法创建AudioTrack。
下面是一个导致内存泄漏的简短示例。整个项目可以下载此 GitHub上。APK文件可在此处下载。
final MediaSync mediaSync = new MediaSync();
mediaSync.setSurface(mSurface);
final Surface inputSurface = mediaSync.createInputSurface(); // There is no the memory leak if I don't create this input surface.
final AudioTrack audioTrack = new AudioTrack.Builder()
.setAudioAttributes(new AudioAttributes.Builder()
.setUsage(AudioAttributes.USAGE_MEDIA)
.setContentType(AudioAttributes.CONTENT_TYPE_MOVIE)
.build())
.setAudioFormat(new AudioFormat.Builder()
.setEncoding(AudioFormat.ENCODING_PCM_16BIT)
.setSampleRate(48000)
.setChannelMask(12)
.build())
.build();
mediaSync.setAudioTrack(audioTrack); // There is no the memory leak if I don't set AudioTrack.
mediaSync.release();
inputSurface.release();
audioTrack.release();
Run Code Online (Sandbox Code Playgroud)
我通过以下方式重现该问题:
Logcat:
2019-03-15 09:19:57.313 239-15387/? E/AudioFlinger: no more track names available
2019-03-15 09:19:57.313 239-15387/? E/AudioFlinger: createTrack_l() initCheck failed -12; no control block?
2019-03-15 09:19:57.313 3413-3413/com.audiotrackmemoryleak E/AudioTrack: AudioFlinger could not create track, status: -12
2019-03-15 09:19:57.313 3413-3413/com.audiotrackmemoryleak E/AudioTrack-JNI: Error -12 initializing AudioTrack
2019-03-15 09:19:57.313 3413-3413/com.audiotrackmemoryleak E/android.media.AudioTrack: Error code -20 when initializing AudioTrack.
2019-03-15 09:19:57.315 3413-3413/com.audiotrackmemoryleak D/AndroidRuntime: Shutting down VM
2019-03-15 09:19:57.316 3413-3413/com.audiotrackmemoryleak E/AndroidRuntime: FATAL EXCEPTION: main
Process: com.audiotrackmemoryleak, PID: 3413
java.lang.UnsupportedOperationException: Cannot create AudioTrack
at android.media.AudioTrack$Builder.build(AudioTrack.java:776)
at com.audiotrackmemoryleak.MainActivity.createMediaSync(MainActivity.java:68)
at com.audiotrackmemoryleak.MainActivity.access$100(MainActivity.java:18)
at com.audiotrackmemoryleak.MainActivity$1.surfaceCreated(MainActivity.java:32)
at android.view.SurfaceView.updateWindow(SurfaceView.java:618)
at ...
Run Code Online (Sandbox Code Playgroud)
该命令adb shell dumpsys media.audio_flinger演示了该问题:
...
Clients:
pid: 3413
Notification Clients:
pid: 239
pid: 841
pid: 3413
pid: 28651
Global session refs:
session pid count
3193 3413 1
3201 3413 1
3209 3413 1
3217 3413 1
3225 3413 1
3233 3413 1
3241 3413 1
3249 3413 1
3257 3413 1
3265 3413 1
3273 3413 1
3281 3413 1
3289 3413 1
3297 3413 1
...
14 Tracks of which 0 are active
Name Active Client Type Fmt Chn mask Session fCount S F SRate L dB R dB Server Main buf Aux Buf Flags UndFrmCnt
7 no 3413 3 00000001 00000003 3249 1924 I 0 48000 0 0 00000000 0xa77fe000 0x0 0x000 0
5 no 3413 3 00000001 00000003 3233 1924 I 0 48000 0 0 00000000 0xa77fe000 0x0 0x000 0
12 no 3413 3 00000001 00000003 3289 1924 I 0 48000 0 0 00000000 0xa77fe000 0x0 0x000 0
3 no 3413 3 00000001 00000003 3217 1924 I 0 48000 0 0 00000000 0xa77fe000 0x0 0x000 0
8 no 3413 3 00000001 00000003 3257 1924 I 0 48000 0 0 00000000 0xa77fe000 0x0 0x000 0
9 no 3413 3 00000001 00000003 3265 1924 I 0 48000 0 0 00000000 0xa77fe000 0x0 0x000 0
4 no 3413 3 00000001 00000003 3225 1924 I 0 48000 0 0 00000000 0xa77fe000 0x0 0x000 0
1 no 3413 3 00000001 00000003 3201 1924 I 0 48000 0 0 00000000 0xa77fe000 0x0 0x000 0
11 no 3413 3 00000001 00000003 3281 1924 I 0 48000 0 0 00000000 0xa77fe000 0x0 0x000 0
0 no 3413 3 00000001 00000003 3193 1924 I 0 48000 0 0 00000000 0xa77fe000 0x0 0x000 0
6 no 3413 3 00000001 00000003 3241 1924 I 0 48000 0 0 00000000 0xa77fe000 0x0 0x000 0
13 no 3413 3 00000001 00000003 3297 1924 I 0 48000 0 0 00000000 0xa77fe000 0x0 0x000 0
2 no 3413 3 00000001 00000003 3209 1924 I 0 48000 0 0 00000000 0xa77fe000 0x0 0x000 0
10 no 3413 3 00000001 00000003 3273 1924 I 0 48000 0 0 00000000 0xa77fe000 0x0 0x000 0
0 Effect Chains
...
Run Code Online (Sandbox Code Playgroud)
我想知道这里是否有人可以解释发生了什么?如何正确释放AudioTrack?
我不确定这是否是 SDK 错误,但它与AudioAttributes.FLAG_DEEP_BUFFER. 当您AudioTrack通过 Builder 构建时,默认设置此标志。见你的情况在这里:的检查shouldEnablePowerSaving()返回true和开关的情况下的结果PERFORMANCE_MODE_POWER_SAVING与FLAG_DEEP_BUFFER实现。
要解决此问题,您应该禁用此标志,例如向.setFlags(AudioAttributes.FLAG_LOW_LATENCY)您的 中添加调用AudioAttributes,但它需要最小 SDK 24。否则您可以AudioTrack.Builder完全放弃使用,并像这样构建轨道:
int audioSampleRate = 48000;
int channelConfig = AudioFormat.CHANNEL_OUT_STEREO;
int bufSize = AudioTrack.getMinBufferSize(audioSampleRate, channelConfig, AudioFormat.ENCODING_PCM_16BIT);
AudioTrack audioTrack = new AudioTrack(AudioManager.STREAM_MUSIC, audioSampleRate,
channelConfig, AudioFormat.ENCODING_PCM_16BIT, bufSize, AudioTrack.MODE_STREAM);
Run Code Online (Sandbox Code Playgroud)
或者你可以检查的代码shouldEnablePowerSaving()检查,使其不以任何其他方式传递。
更新:所以上述解决方案只是将泄漏移至另一个音频线程。我进一步调查并注意到在我的 android 8 设备上处理surfaceCreated()相同的Surface对象。事实上,这是自 android 7 以来的正确行为。我认为它以某种方式破坏了 mediaSync 表面逻辑:如果您在释放之前删除调用mediaSync.createInputSurface()并添加mediaSync.setSurface(null)调用,则泄漏将消失。
我不知道如何解决这个问题,因为Surface系统正在重用它,并且无法知道它何时会被实际销毁。我建议切换到TextureView,它具有类似但更清晰的 API,并且不会在活动暂停时破坏表面。您将需要从中删除createMediaSync()调用onResume()并像这样使用它:
setContentView(R.layout.activity_main);
final TextureView textureView = findViewById(R.id.texture_view);
textureView.setSurfaceTextureListener(new TextureView.SurfaceTextureListener() {
@Override
public void onSurfaceTextureAvailable(SurfaceTexture surface, int width, int height) {
mSurface = new Surface(surface);
createMediaSync();
}
@Override
public void onSurfaceTextureSizeChanged(SurfaceTexture surface, int width, int height) {
}
@Override
public boolean onSurfaceTextureDestroyed(SurfaceTexture surface) {
//release resources here
return true;
}
@Override
public void onSurfaceTextureUpdated(SurfaceTexture surface) {
}
});
Run Code Online (Sandbox Code Playgroud)
祝你好运!
| 归档时间: |
|
| 查看次数: |
336 次 |
| 最近记录: |