从CIImage创建CVPixelBufferRef以写入文件

And*_*rew 3 objective-c core-image core-video ios avassetwriter

我正在编写一个自定义的Movie Recording应用程序,并已实现了AVAssetWriter和AVAssetWriterInputPixelBufferAdaptor,用于将帧写入文件.在DataOutputDelegate回调中,我尝试将CIFilter应用于sampleBuffer.首先,我得到一个CVPixelBufferRef,然后创建一个CIImage.然后我应用CIIFilter并获取生成的CIImage:

    CVPixelBufferRef pixelBuffer = (CVPixelBufferRef)CMSampleBufferGetImageBuffer(sampleBuffer);

    CIImage *image = [CIImage imageWithCVPixelBuffer:pixelBuffer];
    CIFilter *hueAdjust = [CIFilter filterWithName:@"CIHueAdjust"];
    [hueAdjust setDefaults];
    [hueAdjust setValue: image forKey: @"inputImage"];
    [hueAdjust setValue: [NSNumber numberWithFloat: 2.094]
                 forKey: @"inputAngle"];

    CIImage *result = [hueAdjust valueForKey: @"outputImage"];

    CVPixelBufferRef newBuffer = //Convert CIImage...
Run Code Online (Sandbox Code Playgroud)

我将如何转换CIImage以便我可以:

    [self.filteredImageWriter appendPixelBuffer:newBuffer withPresentationTime:lastSampleTime];
Run Code Online (Sandbox Code Playgroud)

小智 9

更新的答案

虽然我以前的方法有效,但我能够调整它以简化代码.它似乎运行得稍快.

samplePixelBuffer = CMSampleBufferGetImageBuffer(sampleBuffer);
CVPixelBufferLockBaseAddress(samplePixelBuffer, 0); // NOT SURE IF NEEDED // NO PERFORMANCE IMPROVEMENTS IF REMOVED

NSDictionary *options = [NSDictionary dictionaryWithObject:(__bridge id)rgbColorSpace forKey:kCIImageColorSpace];                
outputImage = [CIImage imageWithCVPixelBuffer:samplePixelBuffer options:options];

//-----------------
// FILTER OUTPUT IMAGE

@autoreleasepool {

    outputImage = [self applyEffectToCIImage:outputImage dict:dict];

}
CVPixelBufferUnlockBaseAddress(samplePixelBuffer, 0); // NOT SURE IF NEEDED // NO PERFORMANCE IMPROVEMENTS IF REMOVED

//-----------------
// RENDER OUTPUT IMAGE BACK TO PIXEL BUFFER

[self.filterContext render:outputImage toCVPixelBuffer:samplePixelBuffer bounds:[outputImage extent] colorSpace:CGColorSpaceCreateDeviceRGB()]; // DOES NOT SEEM TO WORK USING rgbColorSpace
Run Code Online (Sandbox Code Playgroud)

以前的答案

我刚刚实现了以下内容以从CIImage获取像素缓冲区.确保您的像素格式一致,否则您将遇到颜色问题.CFDictionaries也非常重要.http://allmybrain.com/2011/12/08/rendering-to-a-texture-with-ios-5-texture-cache-api/

CFDictionaryRef empty = CFDictionaryCreate(kCFAllocatorDefault, // EMPTY IOSURFACE DICT
                                           NULL,
                                           NULL,
                                           0,
                                           &kCFTypeDictionaryKeyCallBacks,
                                           &kCFTypeDictionaryValueCallBacks);
CFMutableDictionaryRef attributes = CFDictionaryCreateMutable(kCFAllocatorDefault,
                                                         1,
                                                         &kCFTypeDictionaryKeyCallBacks,
                                                         &kCFTypeDictionaryValueCallBacks);

CFDictionarySetValue(attributes,kCVPixelBufferIOSurfacePropertiesKey,empty);

CVPixelBufferRef pixelBuffer = NULL;
CVReturn status = CVPixelBufferCreate(kCFAllocatorDefault, 
                                      outputImage.extent.size.width, 
                                      outputImage.extent.size.height, 
                                      kCVPixelFormatType_32BGRA, 
                                      attributes, 
                                      &pixelBuffer);

if (status == kCVReturnSuccess && pixelBuffer != NULL) {

    CVPixelBufferLockBaseAddress(pixelBuffer, 0); // NOT SURE IF NEEDED // KEPT JUST IN CASE
    [self.filterContext render:outputImage toCVPixelBuffer:pixelBuffer bounds:[outputImage extent] colorSpace:CGColorSpaceCreateDeviceRGB()];
    CVPixelBufferUnlockBaseAddress(pixelBuffer, 0); // NOT SURE IF NEEDED // KEPT JUST IN CASE

}
Run Code Online (Sandbox Code Playgroud)

  • 这是一个非常有用的答案,但它缺少一条重要的信息给我.什么是[self.filterContext ...].如果我正确理解你的代码,这就是实际将CIImage渲染回Pixel Buffer的部分,这正是我正在寻找的.你能分享一下这个功能吗?谢谢! (9认同)
  • @TimBull我知道这已经有几年了,但对于未来可能会看到这一点的人来说:`self.filteContext`是一个`CIContext`对象.`render`方法将`CIImage`呈现给`CVPixelBuffer`对象:https://developer.apple.com/documentation/coreimage/cicontext/1437853-render (2认同)