Swift Pixelbuffer cicontext.render 有黑色背景,如何使其透明?

Pin*_*Lin 5 opengl-3 ciimage swift

当我使用时func captureOutput(_ captureOutput: AVCaptureOutput!, didOutputSampleBuffer sampleBuffer: CMSampleBuffer!, from connection: AVCaptureConnection!),我需要向sampleBuffer添加透明图像,但我总是得到黑色背景,代码在这里:

let pixelBuffer = CMSampleBufferGetImageBuffer(sampleBuffer)
CVPixelBufferLockBaseAddress(pixelBuffer!, CVPixelBufferLockFlags(rawValue: 0))
let eagleContext = EAGLContext(api: .openGLES3)
let ciContex = CIContext.init(eaglContext: eagleContext!, options: [kCIContextWorkingColorSpace:NSNull()])
let filterdImage = CIImage(cgImage: #imageLiteral(resourceName: "att_id").cgImage!)
let colorSpace = CGColorSpaceCreateDeviceRGB()
ciContex.render(filterdImage, to: pixelBuffer!, bounds: filterdImage.extent, colorSpace: colorSpace)
CVPixelBufferUnlockBaseAddress(pixelBuffer!, CVPixelBufferLockFlags(rawValue: 0))
videoWriterInput.append(sampleBuffer)
Run Code Online (Sandbox Code Playgroud)

我想知道如何获得背景清晰的颜色。

iSp*_*n17 0

注意:此答案假设您有一个背景,您希望在其上使用透明部分渲染图像。


我没有找到让 CIContext 放弃其基本黑色背景的方法,因此我设法解决此问题的唯一方法是创建两层:

  • 一个“基础”层(对我来说,它只是一个CIColor.white,但它可以是你的背景视频帧,任何东西,没有透明度)
  • 图像层

这意味着最终的上下文渲染将如下所示:

let base = CIImage(color: .white) // or some other CIImage which covers the whole frame.
let finalImage = imageWithTransparency.composited(over: base)

context.render(finalImage, 
               to: somePixelBuffer,
               bounds: finalImage.extent,
               colorSpace: someColorSpaceMatchingThePixelBuffer)
Run Code Online (Sandbox Code Playgroud)