如何通过Google CardBoard Android SDK和Rajawali制作简单的VR视频播放器

Question

我是这个地区的新人.我正在尝试更改github中的程序,以便现在播放纸板视频.

我使用StreamingTexture修改了MyRenderer.

public class MyRenderer extends RajawaliCardboardRenderer {

public MyRenderer(Context context) {
    super(context);
}

private MediaPlayer mMediaPlayer;
private StreamingTexture streamingTexture;

@Override
protected void initScene() {
    mMediaPlayer = MediaPlayer.create(this.getContext(), R.raw.test);

    streamingTexture = new StreamingTexture("video", mMediaPlayer);
    Sphere sphere = createPhotoSphereWithTexture(streamingTexture);

    getCurrentScene().addChild(sphere);

    getCurrentCamera().setPosition(Vector3.ZERO);
    getCurrentCamera().setFieldOfView(75);
}

private static Sphere createPhotoSphereWithTexture(ATexture texture) {

    Material material = new Material();
    material.setColor(0);

    try {
        material.addTexture(texture);
    } catch (ATexture.TextureException e) {
        throw new RuntimeException(e);
    }

    Sphere sphere = new Sphere(50, 64, 32);
    sphere.setScaleX(-1);
    sphere.setMaterial(material);

    return sphere;
}
}

我将原始文件夹中的短视频保存为test.mp4,然而,在我启动应用程序后,双方都是空白的,视频的声音实际上正在播放.

我需要一些帮助.非常感谢你!

Answer 1

我在这样工作的滚动板上拍摄了360度视频.

使用RajawaliVRRenderer扩展您的课程

public class YoureVideoClass extends RajawaliVRRenderer {

接下来使用以下initScene():

    @Override
public void initScene() {

    // setup sphere
    Sphere sphere = new Sphere(1, 100, 100);
    sphere.setPosition(0, 0, 0);
    // invert the sphere normals
    // factor "1" is two small and result in rendering glitches
    sphere.setScaleX(100);
    sphere.setScaleY(100);
    sphere.setScaleZ(-100);

    //initiate MediaPlayer
    mediaPlayer = new MediaPlayer();
    mediaPlayer.setLooping(true);
    try {
        Uri videoUrl = Uri.parse("android.resource://" + getContext().getPackageName() + "/"
                + R.raw.test);
        mediaPlayer.setDataSource(getContext(),Uri.parse(videoUrl));
        mediaPlayer.prepareAsync();    //prepare the player (asynchronous)
        mediaPlayer.setOnPreparedListener(new MediaPlayer.OnPreparedListener() {
            @Override
            public void onPrepared(MediaPlayer mp) {
                mp.start(); //start the player only when it is prepared
            }
        });
    } catch (IOException e) {
        e.printStackTrace();
    }

    // create texture from media player video
    videoTexture = new StreamingTexture("video", mediaPlayer);

    // set material with video texture
    Material material = new Material();
    material.setColorInfluence(0f);
    try {
        material.addTexture(videoTexture);
    } catch (ATexture.TextureException e){
        throw new RuntimeException(e);
    }
    sphere.setMaterial(material);

    // add sphere to scene
    getCurrentScene().addChild(sphere);

    super.initScene();
}

在启动场景后,您想要在每个渲染上更新videoTexture,因此添加:

@Override
public void onRender(long elapsedRealTime, double deltaTime) {
    super.onRender(elapsedRealTime, deltaTime);

    if (videoTexture != null) {
        // update texture from video content
        videoTexture.update();
    }
}

最后但并非最不重要的是,您想更新相机以便对纸板进行移动跟踪,如下所示:

@Override
public void onDrawEye(Eye eye) {
    // Rajawali camera
    org.rajawali3d.cameras.Camera currentCamera = getCurrentCamera();

    // cardboard field of view
    FieldOfView fov = eye.getFov();

    // update Rajawali camera from cardboard sdk
    currentCamera.updatePerspective(fov.getLeft(), fov.getRight(), fov.getBottom(), fov.getTop());
    eyeMatrix.setAll(eye.getEyeView());
    // orientation
    eyeOrientation.fromMatrix(eyeMatrix);
    currentCamera.setOrientation(eyeOrientation);
    // position
    eyePosition = eyeMatrix.getTranslation().inverse();
    currentCamera.setPosition(eyePosition);

    // render with Rajawali
    super.onRenderFrame(null);
}

另外,要将其他一些侦听器传递给carboard sdk,您将需要以下功能:

@Override
public void onSurfaceChanged(int width, int height) {
    // tell Rajawali that cardboard sdk detected a size change
    super.onRenderSurfaceSizeChanged(null, width, height);
}

@Override
public void onSurfaceCreated(EGLConfig eglConfig) {
    // pass opengl config to Rajawali
    super.onRenderSurfaceCreated(eglConfig, null, -1, -1);
}

@Override
public void onRenderSurfaceDestroyed(SurfaceTexture surface) {
    super.onRenderSurfaceDestroyed(surface);
}