比如有人想新增一个虚拟摄像头，当用户app打开摄像头设备时，打开的不是系统默认的camera hal代码，而是自己指定的代码，用自己事先准备好的视频数据，来喂给app；也有人想在系统默认的一套app框架上，新增一个外接的usbcamera，并且要能溶入到camera框架中。app只需要指定usbcamera的id，就能像打开普通摄像头那样，去打开我们的usbcamera；也有人，想在现有的框架上，同时兼容老的hal1+api1流程的android8.0之前的camera，又想新增一个符合android8.0的hidl接口规范的camera模块。
上面所有的需求，归纳起来，核心的就是一点，即如何去新增一个camera hal模块。我这篇博客，是以在mtk android8.0上新增一个usbcamera hal模块来讲的。当然，新增虚拟摄像头，流程跟这个也是一模一样的。
好了，既然是想在android8.0上新增一套符合hidl接口规范的camera流程，那么我们先要了解一下，android原生的hidl接口下的camera流程，下面我们先讲一讲这块。
在android8.0之前，frameworks层的cameraservice和hal层的camera代码是在同一个进程的，这样不利于hal层部份独立升级。针对这个问题，8.0后，就推出了hidl机制，将frameworks层和hal层分成了两个进程，从而进行了解耦。借用网上的一张图片来大致的表明下这个区别：
这么一来，看似调用变复杂了，但其实是殊途同归，hal层代码和之前基本上没有变化。具体到camera而言，就是在frameworks层和hal层中间，增加了一个cameraProvider来做为两方联系的桥梁。现在的调用流程，再借网上一张图一用：
接下来以上面这张图来大致的说一下调用流程：
1.) 开机注册cameraProvider（cameraProvider里会和具体的camera hal层对应起来)
2.) 开机实例化cameraService
3.) 查找并列出所有的cameraProvider（这一步会通过hw_get_module来将camera的hal层代码load出来）
这基本上就是camera开机后从frameworks加载到hal层的路线了。下面再具体一步步来分析。
开机注册cameraProvider
在我们的hardware\interfaces\camera\provider\2.4\default目录下，有一个android.hardware.camera.provider@2.4-service.rc文件
service camera-provider-2-4 /vendor/bin/hw/android.hardware.camera.provider@2.4-service
class hal
user cameraserver
group audio camera input drmrpc
ioprio rt 4
capabilities SYS_NICE
writepid /dev/cpuset/camera-daemon/tasks /dev/stune/top-app/tasks
当开机时，会自动调用这个文件去启动服务camera-provider-2-4，然后它会调用到/vendor/bin/hw/android.hardware.camera.provider@2.4-service这个文件。然后会调到hardware\interfaces\camera\provider\2.4\default\service.cpp
int main()
{
ALOGI("Camera provider Service is starting.");
// The camera HAL may communicate to other vendor components via
// /dev/vndbinder
android::ProcessState::initWithDriver("/dev/vndbinder");
return defaultPassthroughServiceImplementation<ICameraProvider>("legacy/0", /*maxThreads*/ 6);
}
然后这里会用hidl的标准接口去将我们的"legacy/0"注册到服务上去。
system\libhidl\transport\include\hidl\LegacySupport.h
template<class Interface>
__attribute__((warn_unused_result))
status_t defaultPassthroughServiceImplementation(std::string name,
size_t maxThreads = 1) {
configureRpcThreadpool(maxThreads, true);
status_t result = registerPassthroughServiceImplementation<Interface>(name);
if (result != OK) {
return result;
}
joinRpcThreadpool();
return 0;
}
在这里有一点要注意,这里的"legacy/0"必须要先在工程根目录 device/***/芯片名/manifest.xml里先声明,否则即使这里注册了,后面也会因为找不到而报错.
<hal format="hidl">
<name>android.hardware.camera.provider</name>
<transport>hwbinder</transport>
<version>2.4</version>
<interface>
<name>ICameraProvider</name>
<instance>legacy/0</instance>
</interface>
</hal>
开机实例化cameraService
在frameworks\av\camera\cameraserver里有个cameraserver.rc, 它在开机的时候,也会自动启动.
service cameraserver /system/bin/cameraserver
class main
user cameraserver
group audio camera input drmrpc
ioprio rt 4
writepid /dev/cpuset/camera-daemon/tasks /dev/stune/top-app/tasks
然后它会调用到frameworks\av\camera\cameraserver\main_cameraserver.cpp
int main(int argc __unused, char** argv __unused)
{
signal(SIGPIPE, SIG_IGN);
//!++
#if 0
// Set 3 threads for HIDL calls
hardware::configureRpcThreadpool(3, /*willjoin*/ false);
#else
// Set 6 threads for HIDL calls, features need more threads to handle preview+capture
hardware::configureRpcThreadpool(6, /*willjoin*/ false);
#endif
//!--
sp<ProcessState> proc(ProcessState::self());
sp<IServiceManager> sm = defaultServiceManager();
ALOGI("ServiceManager: %p", sm.get());
CameraService::instantiate();
ProcessState::self()->startThreadPool();
IPCThreadState::self()->joinThreadPool();
}
在这个main函数里,我们只需要关注CameraService::instantiate();这行代码. 我们的CameraService继承了BinderService.h.这个:instantiate()调用到了BinderService.h里的代码
frameworks\native\libs\binder\include\binder\BinderService.h
template<typename SERVICE>
class BinderService
{
public:
static status_t publish(bool allowIsolated = false) {
sp<IServiceManager> sm(defaultServiceManager());
return sm->addService(
String16(SERVICE::getServiceName()),
new SERVICE(), allowIsolated);
}
static void publishAndJoinThreadPool(bool allowIsolated = false) {
publish(allowIsolated);
joinThreadPool();
}
static void instantiate() { publish(); }
static status_t shutdown() { return NO_ERROR; }
private:
static void joinThreadPool() {
sp<ProcessState> ps(ProcessState::self());
ps->startThreadPool();
ps->giveThreadPoolName();
IPCThreadState::self()->joinThreadPool();
}
};
}; // namespa
从这个文件可以看出,instantiate最终还是调用到了IServiceManager里的addService, 将我们的cameraService注册到了系统的服务管理器里去了.
这里调用到CameraService后, 因为是开机第一次调用,它的引用计数为1,所以会调用到CameraService::onFirstRef()这个函数. 这个函数是从CameraService的父类RefBase里继承过来的.该函数在强引用sp新增引用计数时调用，什么意思？就是当 有sp包装的类初始化的时候调用.我们再看看cameraService::onFirstRef()
frameworks\av\services\camera\libcameraservice\CameraService.cpp
void CameraService::onFirstRef()
{
ALOGI("CameraService process starting");
BnCameraService::onFirstRef();
// Update battery life tracking if service is restarting
BatteryNotifier& notifier(BatteryNotifier::getInstance());
notifier.noteResetCamera();
notifier.noteResetFlashlight();
status_t res = INVALID_OPERATION;
res = enumerateProviders();
if (res == OK) {
mInitialized = true;
}
CameraService::pingCameraServiceProxy();
}
在这个函数里,我们只关注enumerateProviders(),这里就到了列出所有cameraProvider.
查找并列出所有的cameraProvider
status_t CameraService::enumerateProviders() {
status_t res;
Mutex::Autolock l(mServiceLock);
if (nullptr == mCameraProviderManager.get()) {
mCameraProviderManager = new CameraProviderManager();
res = mCameraProviderManager->initialize(this);
......
}
......
}
这个函数里,创建了一个CameraProviderManager对象,并调进行了初始化.
frameworks\av\services\camera\libcameraservice\common\CameraProviderManager.cpp
status_t CameraProviderManager::initialize(wp<CameraProviderManager::StatusListener> listener,
ServiceInteractionProxy* proxy) {
std::lock_guard<std::mutex> lock(mInterfaceMutex);
if (proxy == nullptr) {
ALOGE("%s: No valid service interaction proxy provided", __FUNCTION__);
return BAD_VALUE;
}
mListener = listener;
mServiceProxy = proxy;
// Registering will trigger notifications for all already-known providers
bool success = mServiceProxy->registerForNotifications(
/* instance name, empty means no filter */ "",
this);
if (!success) {
ALOGE("%s: Unable to register with hardware service manager for notifications "
"about camera providers", __FUNCTION__);
return INVALID_OPERATION;
}
// See if there's a passthrough HAL, but let's not complain if there's not
addProviderLocked(kLegacyProviderName, /*expected*/ false);
return OK;
}
在这个初始化函数里,我们只关注addProviderLocked, 我们可以看到,这个函数传进了一个kLegacyProviderName, 它的值定义在这个文件的上面:
const std::string kLegacyProviderName("legacy/0");
大家注意到了没有,它的值和我们之前hardware\interfaces\camera\provider\2.4\default\service.cpp里注册服务时return defaultPassthroughServiceImplementation<ICameraProvider>("legacy/0", /*maxThreads*/ 6); 以及manifest.xml里<instance>legacy/0</instance>的值都是一致的. 如果这个值不致,则会调用不成功.
好了,再回到addProviderLocked这个函数来, 这个函数的作用, 就是去加载camera对应的hal层代码, 并将它的信息保存在ProviderInfo里,后面我们就可以通过这个ProviderInfo, 去实行addDevice、getCameraInfo等操作。
status_t CameraProviderManager::addProviderLocked(const std::string& newProvider, bool expected) {
for (const auto& providerInfo : mProviders) {
if (providerInfo->mProviderName == newProvider) {
ALOGW("%s: Camera provider HAL with name '%s' already registered", __FUNCTION__,
newProvider.c_str());
return ALREADY_EXISTS;
}
}
sp<provider::V2_4::ICameraProvider> interface;
interface = mServiceProxy->getService(newProvider);
if (interface == nullptr) {
if (expected) {
ALOGE("%s: Camera provider HAL '%s' is not actually available", __FUNCTION__,
newProvider.c_str());
return BAD_VALUE;
} else {
return OK;
}
}
sp<ProviderInfo> providerInfo =
new ProviderInfo(newProvider, interface, this);
status_t res = providerInfo->initialize();
if (res != OK) {
return res;
}
mProviders.push_back(providerInfo);
return OK;
}
这里先检查一下，传进来的newProvider是不是已经添加过，如果已经添加了，就不再处理，直接返回。如果没添加过，就会进行下一步的操作。这里的interface = mServiceProxy->getService(newProvider);，会调用到hardware\interfaces\camera\provider\2.4\default\CameraProvider.cpp的HIDL_FETCH_ICameraProvider函数。
ICameraProvider* HIDL_FETCH_ICameraProvider(const char* name) {
if (strcmp(name, kLegacyProviderName) != 0) {
return nullptr;
}
CameraProvider* provider = new CameraProvider();
if (provider == nullptr) {
ALOGE("%s: cannot allocate camera provider!", __FUNCTION__);
return nullptr;
}
if (provider->isInitFailed()) {
ALOGE("%s: camera provider init failed!", __FUNCTION__);
delete provider;
return nullptr;
}
return provider;
}
在这个函数里，会创建一个CameraProvider对象。
CameraProvider::CameraProvider() :
camera_module_callbacks_t({sCameraDeviceStatusChange,
sTorchModeStatusChange}) {
mInitFailed = initialize();
}
bool CameraProvider::initialize() {
camera_module_t *rawModule;
int err = hw_get_module("camera", (const hw_module_t **)&rawModule);
if (err < 0) {
ALOGE("Could not load camera HAL module: %d (%s)", err, strerror(-err));
return true;
}
mModule = new CameraModule(rawModule);
err = mModule->init();
......
}
在这个初始化函数中，会看到一个我们非常熟悉的函数hw_get_module。到这里，就跟我们android8.0之前的流程一模一样的了，都是去直接和hal层打交道了。
在CameraProvider里有一个地方值得大家注意
std::string cameraId, int deviceVersion) {
// Maybe consider create a version check method and SortedVec to speed up?
if (deviceVersion != CAMERA_DEVICE_API_VERSION_1_0 &&
deviceVersion != CAMERA_DEVICE_API_VERSION_3_2 &&
deviceVersion != CAMERA_DEVICE_API_VERSION_3_3 &&
deviceVersion != CAMERA_DEVICE_API_VERSION_3_4 ) {
return hidl_string("");
}
bool isV1 = deviceVersion == CAMERA_DEVICE_API_VERSION_1_0;
int versionMajor = isV1 ? 1 : 3;
int versionMinor = isV1 ? 0 : mPreferredHal3MinorVersion;
char deviceName[kMaxCameraDeviceNameLen];
snprintf(deviceName, sizeof(deviceName), "device@%d.%d/legacy/%s",
versionMajor, versionMinor, cameraId.c_str());
return deviceName;
}
从这里看来，如果我们的camera使用了hidl和hal打交道的话，我们hal里的版本号，必须是1.0或者是大于3.2的，如果我们的hal层的的版本号为3.0或3.1的话，是不能正确的加载成功的。
上面用到的图片，引用了https://blog.csdn.net/qq_16775897/article/details/81240600这个博客的，大家也可以去这篇博客看看。启动流程都是一致的，这博主也讲得比较详细。
好了，上面就将android8.0上camera hal层代码的加载流程基本讲完了。有了上面的基础，下面我们再来一步步的讲下，怎么去新增一个camera hal。
###############################################################################################################################################################################################################################################################################################################
移植一个camera hal，需要做的有以下几点：
1.）在device\mediatek\mt6580\manifest.xml里新增要增加的camera的instance
2.）在frameworks\av\services\camera\libcameraservice\common\CameraProviderManager.cpp里，将要添加的camera provider给addProviderLocked进来
3.）在hardware\interfaces\camera\provider\2.4\default\CameraProvider.cpp里将要增加的camera，通过hw_get_module这样给load进来。
4.）准备好对应的camera hal代码
配置manifest.xml
<hal format="hidl">
<name>android.hardware.camera.provider</name>
<transport>hwbinder</transport>
<version>2.4</version>
<interface>
<name>ICameraProvider</name>
<instance>internal/0</instance>
<instance>legacy/1</instance>
</interface>
</hal>
因为mtkcamera已经有了一个camera hal1，名字为internal/0， 所以我们的usbcamera对应的名字跟在它的后面即可。注意，“legacy/1”这个名字的前面“legacy”这串，可以随便取，比如可以叫”abc/1"，只要其他用到的地方都叫这个名字就可以。但是这个后面的“1”，不能弄错。前面已经为0了，这个就必须为1，同理，如果还有一个摄像头，就要为2了。因为在CameraProviderManager.cpp里的ProviderInfo::parseDeviceName，是通过后面这个数字，来取对应的id值的。如果我们将这个usbcamera的id也写为0，即名字为“legacy/0”，那么在ProviderInfo::parseDeviceName这里取出来的id，就会和前面的已经有了的主摄冲突。
添加camera的ProviderInfo
在frameworks\av\services\camera\libcameraservice\common\CameraProviderManager.cpp的initialize函数里，将kLegacyProviderName改成"legacy/1"
status_t CameraProviderManager::initialize(wp<CameraProviderManager::StatusListener> listener,
ServiceInteractionProxy* proxy) {
......
// See if there's a passthrough HAL, but let's not complain if there's not
addProviderLocked("legacy/1", /*expected*/ false);
return OK;
}
在hardware\interfaces\camera\provider\2.4\default\service.cpp里的main函数里，将"legacy/1"注册上来
int main()
{
ALOGI("Camera provider Service is starting.");
// The camera HAL may communicate to other vendor components via
// /dev/vndbinder
android::ProcessState::initWithDriver("/dev/vndbinder");
return defaultPassthroughServiceImplementation<ICameraProvider>("legacy/1", /*maxThreads*/ 6);
}
在hardware\interfaces\camera\provider\2.4\default\CameraProvider.cpp里，将kLegacyProviderName改成"legacy/1";它会被HIDL_FETCH_ICameraProvider调用。
hw_get_module对应camera的hal代码
在hardware\interfaces\camera\provider\2.4\default\CameraProvider.cpp里的initialize()函数里，hw_get_module参数传进去的名字，改成我们usbcamera hal里指定的名字
int err = hw_get_module("usbcamera", (const hw_module_t **)&rawModule);
准备好对应的camera hal代码
我们的usbcamera hal代码，我们放在hardware\libhardware\modules\camera\libuvccamera下面。在这个目录里，有个HalModule.cpp文件，里面定义了camera_module_t的结构体，它的id就是"usbcamera"， 在CameraProvider.cpp里hw_get_module时，发现这里定义的id和它要找的id一致，就会load到我们的usbcamera了。
#include <hardware/camera_common.h>
#include <cutils/log.h>
#include <utils/misc.h>
#include <cstdlib>
#include <cassert>
#include "Camera.h"
/******************************************************************************\
DECLARATIONS
Not used in any other project source files, header file is redundant
\******************************************************************************/
extern camera_module_t HAL_MODULE_INFO_SYM;
namespace android {
namespace HalModule {
/* Available cameras */
extern Camera *cams[];
static int getNumberOfCameras();
static int getCameraInfo(int cameraId, struct camera_info *info);
static int setCallbacks(const camera_module_callbacks_t *callbacks);
static void getVendorTagOps(vendor_tag_ops_t* ops);
static int openDevice(const hw_module_t *module, const char *name, hw_device_t **device);
static struct hw_module_methods_t moduleMethods = {
.open = openDevice
};
}; /* namespace HalModule */
}; /* namespace android */
/******************************************************************************\
DEFINITIONS
\******************************************************************************/
camera_module_t HAL_MODULE_INFO_SYM = {
.common = {
.tag = HARDWARE_MODULE_TAG,
.module_api_version = CAMERA_MODULE_API_VERSION_2_3,
.hal_api_version = HARDWARE_HAL_API_VERSION,
.id = "usbcamera",
.name = "V4l2 Camera",
.author = "Antmicro Ltd.",
.methods = &android::HalModule::moduleMethods,
.dso = NULL,
.reserved = {0}
},
.get_number_of_cameras = android::HalModule::getNumberOfCameras,
.get_camera_info = android::HalModule::getCameraInfo,
.set_callbacks = android::HalModule::setCallbacks,
};
namespace android {
namespace HalModule {
static Camera mainCamera;
Camera *cams[] = {
&mainCamera
};
static int getNumberOfCameras() {
return NELEM(cams);
};
static int getCameraInfo(int cameraId, struct camera_info *info) {
cameraId = 0;//cameraId - 1;
if(cameraId < 0 || cameraId >= getNumberOfCameras()) {
return -ENODEV;
}
if(!cams[cameraId]->isValid()) {
return -ENODEV;
}
return cams[cameraId]->cameraInfo(info);
}
int setCallbacks(const camera_module_callbacks_t * /*callbacks*/) {
ALOGI("%s: lihb setCallbacks", __FUNCTION__);
/* TODO: Implement for hotplug support */
return OK;
}
static int openDevice(const hw_module_t *module, const char *name, hw_device_t **device) {
if (module != &HAL_MODULE_INFO_SYM.common) {
return -EINVAL;
}
if (name == NULL) {
return -EINVAL;
}
errno = 0;
int cameraId = (int)strtol(name, NULL, 10);
cameraId = 0;
if(errno || cameraId < 0 || cameraId >= getNumberOfCameras()) {
return -EINVAL;
}
if(!cams[cameraId]->isValid()) {
*device = NULL;
return -ENODEV;
}
return cams[cameraId]->openDevice(device);
}
}; /* namespace HalModule */
}; /* namespace android */
大家可能会发现，在getCameraInfo函数里，我将cameraId写死成了0，但是前面我们不是刚说过，我们的usbcamera是第二个摄像头，id要为1么？其实这里的id，和前面说的那个id，不是同一个意思。在这里之所以写成0，是因为我们这套usbcamera hal代码上面，只挂了一个摄像头，这个摄像头对应的代码放在Camera *cams[]数组里，这个数组里只放了一个对象，所以id自然就要为0了。然后我们在我们的halModule.cpp里操作getCameraInfo或openDevice时，就会通过这个数组调用到static Camera mainCamera;这里定义的这个Camera对象了。这个Camera，也是我们自己写的代码：
//Camera.h
#ifndef CAMERA_H
#define CAMERA_H
#include <utils/Errors.h>
#include <hardware/camera_common.h>
#include <V4l2Device.h>
#include <hardware/camera3.h>
#include <camera/CameraMetadata.h>
#include <utils/Mutex.h>
#include "Workers.h"
#include "ImageConverter.h"
#include "DbgUtils.h"
#include <cutils/ashmem.h>
#include <cutils/log.h>
#include <sys/mman.h>
#include "VGA_YUV422.h"
namespace android {
class Camera: public camera3_device {
public:
Camera();
virtual ~Camera();
bool isValid() { return mValid; }
virtual status_t cameraInfo(struct camera_info *info);
virtual int openDevice(hw_device_t **device);
virtual int closeDevice();
protected:
virtual camera_metadata_t * staticCharacteristics();
virtual int initialize(const camera3_callback_ops_t *callbackOps);
virtual int configureStreams(camera3_stream_configuration_t *streamList);
virtual const camera_metadata_t * constructDefaultRequestSettings(int type);
virtual int registerStreamBuffers(const camera3_stream_buffer_set_t *bufferSet);
virtual int processCaptureRequest(camera3_capture_request_t *request);
/* HELPERS/SUBPROCEDURES */
void notifyShutter(uint32_t frameNumber, uint64_t timestamp);
void processCaptureResult(uint32_t frameNumber, const camera_metadata_t *result, const Vector<camera3_stream_buffer> &buffers);
camera_metadata_t *mStaticCharacteristics;
camera_metadata_t *mDefaultRequestSettings[CAMERA3_TEMPLATE_COUNT];
CameraMetadata mLastRequestSettings;
V4l2Device *mDev;
bool mValid;
const camera3_callback_ops_t *mCallbackOps;
size_t mJpegBufferSize;
private:
ImageConverter mConverter;
Mutex mMutex;
uint8_t* mFrameBuffer;
uint8_t* rszbuffer;
int mProperty_enableTimesTamp = -1;
/* STATIC WRAPPERS */
static int sClose(hw_device_t *device);
static int sInitialize(const struct camera3_device *device, const camera3_callback_ops_t *callback_ops);
static int sConfigureStreams(const struct camera3_device *device, camera3_stream_configuration_t *stream_list);
static int sRegisterStreamBuffers(const struct camera3_device *device, const camera3_stream_buffer_set_t *buffer_set);
static const camera_metadata_t * sConstructDefaultRequestSettings(const struct camera3_device *device, int type);
static int sProcessCaptureRequest(const struct camera3_device *device, camera3_capture_request_t *request);
static void sGetMetadataVendorTagOps(const struct camera3_device *device, vendor_tag_query_ops_t* ops);
static void sDump(const struct camera3_device *device, int fd);
static int sFlush(const struct camera3_device *device);
static void _AddTimesTamp(uint8_t* buffer, int32_t width, int32_t height);
static camera3_device_ops_t sOps;
};
}; /* namespace android */
#endif // CAMERA_H
/*
* Copyright (C) 2015-2016 Antmicro
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/
#define LOG_TAG "usb-Camera"
#define LOG_NDEBUG 0
#include <hardware/camera3.h>
#include <camera/CameraMetadata.h>
#include <utils/misc.h>
#include <utils/Log.h>
#include <hardware/gralloc.h>
#include <ui/Rect.h>
#include <ui/GraphicBufferMapper.h>
#include <ui/Fence.h>
#include <assert.h>
#include "DbgUtils.h"
#include "Camera.h"
#include "ImageConverter.h"
#include "libyuv.h"
//#include <sprd_exvideo.h>
#include <cutils/properties.h>
#include <cstdlib>
#include <cstdio>
namespace android {
/**
* \class Camera
*
* Android's Camera 3 device implementation.
*
* Declaration of camera capabilities, frame request handling, etc. This code
* is what Android framework talks to.
*/
Camera::Camera()
: mStaticCharacteristics(NULL)
, mCallbackOps(NULL)
, mJpegBufferSize(0) {
ALOGI("Camera() start");
DBGUTILS_AUTOLOGCALL(__func__);
for(size_t i = 0; i < NELEM(mDefaultRequestSettings); i++) {
mDefaultRequestSettings[i] = NULL;
}
common.tag = HARDWARE_DEVICE_TAG;
common.version = CAMERA_DEVICE_API_VERSION_3_2;//CAMERA_DEVICE_API_VERSION_3_0;
common.module = &HAL_MODULE_INFO_SYM.common;
common.close = Camera::sClose;
ops = &sOps;
priv = NULL;
mValid = true;
mFrameBuffer = new uint8_t[640*480*4];
rszbuffer = new uint8_t[640*480*4];
mDev = new V4l2Device();
if(!mDev) {
mValid = false;
}
}
Camera::~Camera() {
DBGUTILS_AUTOLOGCALL(__func__);
gWorkers.stop();
mDev->disconnect();
delete[] mFrameBuffer;
delete[] rszbuffer;
delete mDev;
}
status_t Camera::cameraInfo(struct camera_info *info) {
DBGUTILS_AUTOLOGCALL(__func__);
ALOGI("Camera::cameraInfo entry");
ALOGE("Camera::cameraInfo entry");
Mutex::Autolock lock(mMutex);
info->facing = CAMERA_FACING_FRONT;//BACK;//FRONT;
info->orientation = 0;
info->device_version = CAMERA_DEVICE_API_VERSION_3_2;//CAMERA_DEVICE_API_VERSION_3_0;//CAMERA_DEVICE_API_VERSION_3_4;
info->static_camera_characteristics = staticCharacteristics();
return NO_ERROR;
}
int Camera::openDevice(hw_device_t **device) {
ALOGI("%s",__FUNCTION__);
DBGUTILS_AUTOLOGCALL(__func__);
Mutex::Autolock lock(mMutex);
char enableTimesTamp[PROPERTY_VALUE_MAX];
char enableAVI[PROPERTY_VALUE_MAX];
mDev->connect();
*device = &common;
gWorkers.start();
return NO_ERROR;
}
int Camera::closeDevice() {
ALOGI("%s",__FUNCTION__);
DBGUTILS_AUTOLOGCALL(__func__);
Mutex::Autolock lock(mMutex);
gWorkers.stop();
mDev->disconnect();
return NO_ERROR;
}
camera_metadata_t *Camera::staticCharacteristics() {
if(mStaticCharacteristics)
return mStaticCharacteristics;
CameraMetadata cm;
auto &resolutions = mDev->availableResolutions();
auto &previewResolutions = resolutions;
auto sensorRes = mDev->sensorResolution();
/***********************************\
|* START OF CAMERA CHARACTERISTICS *|
\***********************************/
/* fake, but valid aspect ratio */
const float sensorInfoPhysicalSize[] = {
5.0f,
5.0f * (float)sensorRes.height / (float)sensorRes.width
};
cm.update(ANDROID_SENSOR_INFO_PHYSICAL_SIZE, sensorInfoPhysicalSize, NELEM(sensorInfoPhysicalSize));
/* fake */
static const float lensInfoAvailableFocalLengths[] = {3.30f};
cm.update(ANDROID_LENS_INFO_AVAILABLE_FOCAL_LENGTHS, lensInfoAvailableFocalLengths, NELEM(lensInfoAvailableFocalLengths));
static const uint8_t lensFacing = ANDROID_LENS_FACING_FRONT;
cm.update(ANDROID_LENS_FACING, &lensFacing, 1);
const int32_t sensorInfoPixelArraySize[] = {
(int32_t)sensorRes.width,
(int32_t)sensorRes.height
};
cm.update(ANDROID_SENSOR_INFO_PIXEL_ARRAY_SIZE, sensorInfoPixelArraySize, NELEM(sensorInfoPixelArraySize));
const int32_t sensorInfoActiveArraySize[] = {
0, 0,
(int32_t)sensorRes.width, (int32_t)sensorRes.height
};
cm.update(ANDROID_SENSOR_INFO_ACTIVE_ARRAY_SIZE, sensorInfoActiveArraySize, NELEM(sensorInfoActiveArraySize));
static const int32_t scalerAvailableFormats[] = {
HAL_PIXEL_FORMAT_RGBA_8888, //预览流
HAL_PIXEL_FORMAT_IMPLEMENTATION_DEFINED,//预览流
/* Non-preview one, must be last - see following code */
HAL_PIXEL_FORMAT_BLOB//拍照流
};
cm.update(ANDROID_SCALER_AVAILABLE_FORMATS, scalerAvailableFormats, NELEM(scalerAvailableFormats));
/* Only for HAL_PIXEL_FORMAT_BLOB */
const size_t mainStreamConfigsCount = resolutions.size();
/* For all other supported pixel formats */
const size_t previewStreamConfigsCount = previewResolutions.size() * (NELEM(scalerAvailableFormats) - 1);
const size_t streamConfigsCount = mainStreamConfigsCount + previewStreamConfigsCount;
int32_t scalerAvailableStreamConfigurations[streamConfigsCount * 4];
int64_t scalerAvailableMinFrameDurations[streamConfigsCount * 4];
int32_t scalerAvailableProcessedSizes[previewResolutions.size() * 2];
int64_t scalerAvailableProcessedMinDurations[previewResolutions.size()];
int32_t scalerAvailableJpegSizes[resolutions.size() * 2];
int64_t scalerAvailableJpegMinDurations[resolutions.size()];
size_t i4 = 0;
size_t i2 = 0;
size_t i1 = 0;
/* Main stream configurations */
for(size_t resId = 0; resId < resolutions.size(); ++resId) {
scalerAvailableStreamConfigurations[i4 + 0] = HAL_PIXEL_FORMAT_BLOB;
scalerAvailableStreamConfigurations[i4 + 1] = (int32_t)resolutions[resId].width;
scalerAvailableStreamConfigurations[i4 + 2] = (int32_t)resolutions[resId].height;
scalerAvailableStreamConfigurations[i4 + 3] = ANDROID_SCALER_AVAILABLE_STREAM_CONFIGURATIONS_OUTPUT;
scalerAvailableMinFrameDurations[i4 + 0] = HAL_PIXEL_FORMAT_BLOB;
scalerAvailableMinFrameDurations[i4 + 1] = (int32_t)resolutions[resId].width;
scalerAvailableMinFrameDurations[i4 + 2] = (int32_t)resolutions[resId].height;
scalerAvailableMinFrameDurations[i4 + 3] = 1000000000 / 30; /* TODO: read from the device */
scalerAvailableJpegSizes[i2 + 0] = (int32_t)resolutions[resId].width;
scalerAvailableJpegSizes[i2 + 1] = (int32_t)resolutions[resId].height;
scalerAvailableJpegMinDurations[i1] = 1000000000 / 30; /* TODO: read from the device */
i4 += 4;
i2 += 2;
i1 += 1;
}
i2 = 0;
i1 = 0;
/* Preview stream configurations */
for(size_t resId = 0; resId < previewResolutions.size(); ++resId) {
for(size_t fmtId = 0; fmtId < NELEM(scalerAvailableFormats) - 1; ++fmtId) {
scalerAvailableStreamConfigurations[i4 + 0] = scalerAvailableFormats[fmtId];
scalerAvailableStreamConfigurations[i4 + 1] = (int32_t)previewResolutions[resId].width;
scalerAvailableStreamConfigurations[i4 + 2] = (int32_t)previewResolutions[resId].height;
scalerAvailableStreamConfigurations[i4 + 3] = ANDROID_SCALER_AVAILABLE_STREAM_CONFIGURATIONS_OUTPUT;
scalerAvailableMinFrameDurations[i4 + 0] = scalerAvailableFormats[fmtId];
scalerAvailableMinFrameDurations[i4 + 1] = (int32_t)previewResolutions[resId].width;
scalerAvailableMinFrameDurations[i4 + 2] = (int32_t)previewResolutions[resId].height;
scalerAvailableMinFrameDurations[i4 + 3] = 1000000000 / 10; /* TODO: read from the device */
i4 += 4;
}
scalerAvailableProcessedSizes[i2 + 0] = (int32_t)previewResolutions[resId].width;
scalerAvailableProcessedSizes[i2 + 1] = (int32_t)previewResolutions[resId].height;
scalerAvailableProcessedMinDurations[i1] = 1000000000 / 10; /* TODO: read from the device */
i2 += 2;
i1 += 1;
}
cm.update(ANDROID_SCALER_AVAILABLE_STREAM_CONFIGURATIONS, scalerAvailableStreamConfigurations, (size_t)NELEM(scalerAvailableStreamConfigurations));
cm.update(ANDROID_SCALER_AVAILABLE_MIN_FRAME_DURATIONS, scalerAvailableMinFrameDurations, (size_t)NELEM(scalerAvailableMinFrameDurations));
/* Probably fake */
cm.update(ANDROID_SCALER_AVAILABLE_STALL_DURATIONS, scalerAvailableMinFrameDurations, (size_t)NELEM(scalerAvailableMinFrameDurations));
cm.update(ANDROID_SCALER_AVAILABLE_JPEG_SIZES, scalerAvailableJpegSizes, (size_t)NELEM(scalerAvailableJpegSizes));
cm.update(ANDROID_SCALER_AVAILABLE_JPEG_MIN_DURATIONS, scalerAvailableJpegMinDurations, (size_t)NELEM(scalerAvailableJpegMinDurations));
cm.update(ANDROID_SCALER_AVAILABLE_PROCESSED_SIZES, scalerAvailableProcessedSizes, (size_t)NELEM(scalerAvailableProcessedSizes));
cm.update(ANDROID_SCALER_AVAILABLE_PROCESSED_MIN_DURATIONS, scalerAvailableProcessedMinDurations, (size_t)NELEM(scalerAvailableProcessedMinDurations));
//添加capabilities集，否则api2的接口，在调用getStreamConfigurationMap去获取REQUEST_AVAILABLE_CAPABILITIES值时会失败。
Vector<uint8_t> available_capabilities;
available_capabilities.add(ANDROID_REQUEST_AVAILABLE_CAPABILITIES_READ_SENSOR_SETTINGS);
available_capabilities.add(ANDROID_REQUEST_AVAILABLE_CAPABILITIES_PRIVATE_REPROCESSING);
available_capabilities.add(ANDROID_REQUEST_AVAILABLE_CAPABILITIES_YUV_REPROCESSING);
cm.update(ANDROID_REQUEST_AVAILABLE_CAPABILITIES,
available_capabilities.array(),
available_capabilities.size());
/* ~8.25 bit/px (https://en.wikipedia.org/wiki/JPEG#Sample_photographs) */
/* Use 9 bit/px, add buffer info struct size, round up to page size */
mJpegBufferSize = sensorRes.width * sensorRes.height * 9 + sizeof(camera3_jpeg_blob);
mJpegBufferSize = (mJpegBufferSize + PAGE_SIZE - 1u) & ~(PAGE_SIZE - 1u);
const int32_t jpegMaxSize = (int32_t)mJpegBufferSize;
cm.update(ANDROID_JPEG_MAX_SIZE, &jpegMaxSize, 1);
static const int32_t jpegAvailableThumbnailSizes[] = {
0, 0,
320, 240
};
cm.update(ANDROID_JPEG_AVAILABLE_THUMBNAIL_SIZES, jpegAvailableThumbnailSizes, NELEM(jpegAvailableThumbnailSizes));
static const int32_t sensorOrientation = 90;
cm.update(ANDROID_SENSOR_ORIENTATION, &sensorOrientation, 1);
static const uint8_t flashInfoAvailable = ANDROID_FLASH_INFO_AVAILABLE_FALSE;
cm.update(ANDROID_FLASH_INFO_AVAILABLE, &flashInfoAvailable, 1);
static const float scalerAvailableMaxDigitalZoom = 1;
cm.update(ANDROID_SCALER_AVAILABLE_MAX_DIGITAL_ZOOM, &scalerAvailableMaxDigitalZoom, 1);
static const uint8_t statisticsFaceDetectModes[] = {
ANDROID_STATISTICS_FACE_DETECT_MODE_OFF
};
cm.update(ANDROID_STATISTICS_FACE_DETECT_MODE, statisticsFaceDetectModes, NELEM(statisticsFaceDetectModes));
static const int32_t statisticsInfoMaxFaceCount = 0;
cm.update(ANDROID_STATISTICS_INFO_MAX_FACE_COUNT, &statisticsInfoMaxFaceCount, 1);
static const uint8_t controlAvailableSceneModes[] = {
ANDROID_CONTROL_SCENE_MODE_DISABLED
};
cm.update(ANDROID_CONTROL_AVAILABLE_SCENE_MODES, controlAvailableSceneModes, NELEM(controlAvailableSceneModes));
static const uint8_t controlAvailableEffects[] = {
ANDROID_CONTROL_EFFECT_MODE_OFF
};
cm.update(ANDROID_CONTROL_AVAILABLE_EFFECTS, controlAvailableEffects, NELEM(controlAvailableEffects));
static const int32_t controlMaxRegions[] = {
0, /* AE */
0, /* AWB */
0 /* AF */
};
cm.update(ANDROID_CONTROL_MAX_REGIONS, controlMaxRegions, NELEM(controlMaxRegions));
static const uint8_t controlAeAvailableModes[] = {
ANDROID_CONTROL_AE_MODE_OFF
};
cm.update(ANDROID_CONTROL_AE_AVAILABLE_MODES, controlAeAvailableModes, NELEM(controlAeAvailableModes));
static const camera_metadata_rational controlAeCompensationStep = {1, 3};
cm.update(ANDROID_CONTROL_AE_COMPENSATION_STEP, &controlAeCompensationStep, 1);
int32_t controlAeCompensationRange[] = {-9, 9};
cm.update(ANDROID_CONTROL_AE_COMPENSATION_RANGE, controlAeCompensationRange, NELEM(controlAeCompensationRange));
static const int32_t controlAeAvailableTargetFpsRanges[] = {
10, 20
};
cm.update(ANDROID_CONTROL_AE_AVAILABLE_TARGET_FPS_RANGES, controlAeAvailableTargetFpsRanges, NELEM(controlAeAvailableTargetFpsRanges));
static const uint8_t controlAeAvailableAntibandingModes[] = {
ANDROID_CONTROL_AE_ANTIBANDING_MODE_OFF
};
cm.update(ANDROID_CONTROL_AE_AVAILABLE_ANTIBANDING_MODES, controlAeAvailableAntibandingModes, NELEM(controlAeAvailableAntibandingModes));
static const uint8_t controlAwbAvailableModes[] = {
ANDROID_CONTROL_AWB_MODE_AUTO,
ANDROID_CONTROL_AWB_MODE_OFF
};
cm.update(ANDROID_CONTROL_AWB_AVAILABLE_MODES, controlAwbAvailableModes, NELEM(controlAwbAvailableModes));
static const uint8_t controlAfAvailableModes[] = {
ANDROID_CONTROL_AF_MODE_OFF
};
cm.update(ANDROID_CONTROL_AF_AVAILABLE_MODES, controlAfAvailableModes, NELEM(controlAfAvailableModes));
static const uint8_t controlAvailableVideoStabilizationModes[] = {
ANDROID_CONTROL_VIDEO_STABILIZATION_MODE_OFF
};
cm.update(ANDROID_CONTROL_AVAILABLE_VIDEO_STABILIZATION_MODES, controlAvailableVideoStabilizationModes, NELEM(controlAvailableVideoStabilizationModes));
const uint8_t infoSupportedHardwareLevel = ANDROID_INFO_SUPPORTED_HARDWARE_LEVEL_LIMITED;
cm.update(ANDROID_INFO_SUPPORTED_HARDWARE_LEVEL, &infoSupportedHardwareLevel, 1);
/***********************************\
|* END OF CAMERA CHARACTERISTICS *|
\***********************************/
mStaticCharacteristics = cm.release();
return mStaticCharacteristics;
}
int Camera::initialize(const camera3_callback_ops_t *callbackOps) {
DBGUTILS_AUTOLOGCALL(__func__);
Mutex::Autolock lock(mMutex);
mCallbackOps = callbackOps;
return NO_ERROR;
}
const camera_metadata_t * Camera::constructDefaultRequestSettings(int type) {
DBGUTILS_AUTOLOGCALL(__func__);
Mutex::Autolock lock(mMutex);
/* TODO: validate type */
if(mDefaultRequestSettings[type]) {
return mDefaultRequestSettings[type];
}
CameraMetadata cm;
static const int32_t requestId = 0;
cm.update(ANDROID_REQUEST_ID, &requestId, 1);
static const float lensFocusDistance = 0.0f;
cm.update(ANDROID_LENS_FOCUS_DISTANCE, &lensFocusDistance, 1);
auto sensorSize = mDev->sensorResolution();
const int32_t scalerCropRegion[] = {
0, 0,
(int32_t)sensorSize.width, (int32_t)sensorSize.height
};
cm.update(ANDROID_SCALER_CROP_REGION, scalerCropRegion, NELEM(scalerCropRegion));
static const int32_t jpegThumbnailSize[] = {
0, 0
};
cm.update(ANDROID_JPEG_THUMBNAIL_SIZE, jpegThumbnailSize, NELEM(jpegThumbnailSize));
static const uint8_t jpegThumbnailQuality = 50;
cm.update(ANDROID_JPEG_THUMBNAIL_QUALITY, &jpegThumbnailQuality, 1);
static const double jpegGpsCoordinates[] = {
0, 0
};
cm.update(ANDROID_JPEG_GPS_COORDINATES, jpegGpsCoordinates, NELEM(jpegGpsCoordinates));
static const uint8_t jpegGpsProcessingMethod[32] = "None";
cm.update(ANDROID_JPEG_GPS_PROCESSING_METHOD, jpegGpsProcessingMethod, NELEM(jpegGpsProcessingMethod));
static const int64_t jpegGpsTimestamp = 0;
cm.update(ANDROID_JPEG_GPS_TIMESTAMP, &jpegGpsTimestamp, 1);
static const int32_t jpegOrientation = 0;
cm.update(ANDROID_JPEG_ORIENTATION, &jpegOrientation, 1);
/** android.stats */
static const uint8_t statisticsFaceDetectMode = ANDROID_STATISTICS_FACE_DETECT_MODE_OFF;
cm.update(ANDROID_STATISTICS_FACE_DETECT_MODE, &statisticsFaceDetectMode, 1);
static const uint8_t statisticsHistogramMode = ANDROID_STATISTICS_HISTOGRAM_MODE_OFF;
cm.update(ANDROID_STATISTICS_HISTOGRAM_MODE, &statisticsHistogramMode, 1);
static const uint8_t statisticsSharpnessMapMode = ANDROID_STATISTICS_SHARPNESS_MAP_MODE_OFF;
cm.update(ANDROID_STATISTICS_SHARPNESS_MAP_MODE, &statisticsSharpnessMapMode, 1);
uint8_t controlCaptureIntent = 0;
switch (type) {
case CAMERA3_TEMPLATE_PREVIEW: controlCaptureIntent = ANDROID_CONTROL_CAPTURE_INTENT_PREVIEW; break;
case CAMERA3_TEMPLATE_STILL_CAPTURE: controlCaptureIntent = ANDROID_CONTROL_CAPTURE_INTENT_STILL_CAPTURE; break;
case CAMERA3_TEMPLATE_VIDEO_RECORD: controlCaptureIntent = ANDROID_CONTROL_CAPTURE_INTENT_VIDEO_RECORD; break;
case CAMERA3_TEMPLATE_VIDEO_SNAPSHOT: controlCaptureIntent = ANDROID_CONTROL_CAPTURE_INTENT_VIDEO_SNAPSHOT; break;
case CAMERA3_TEMPLATE_ZERO_SHUTTER_LAG: controlCaptureIntent = ANDROID_CONTROL_CAPTURE_INTENT_ZERO_SHUTTER_LAG; break;
default: controlCaptureIntent = ANDROID_CONTROL_CAPTURE_INTENT_CUSTOM; break;
}
cm.update(ANDROID_CONTROL_CAPTURE_INTENT, &controlCaptureIntent, 1);
static const uint8_t controlMode = ANDROID_CONTROL_MODE_OFF;
cm.update(ANDROID_CONTROL_MODE, &controlMode, 1);
static const uint8_t controlEffectMode = ANDROID_CONTROL_EFFECT_MODE_OFF;
cm.update(ANDROID_CONTROL_EFFECT_MODE, &controlEffectMode, 1);
static const uint8_t controlSceneMode = ANDROID_CONTROL_SCENE_MODE_FACE_PRIORITY;
cm.update(ANDROID_CONTROL_SCENE_MODE, &controlSceneMode, 1);
static const uint8_t controlAeMode = ANDROID_CONTROL_AE_MODE_OFF;
cm.update(ANDROID_CONTROL_AE_MODE, &controlAeMode, 1);
static const uint8_t controlAeLock = ANDROID_CONTROL_AE_LOCK_OFF;
cm.update(ANDROID_CONTROL_AE_LOCK, &controlAeLock, 1);
static const int32_t controlAeRegions[] = {
0, 0,
(int32_t)sensorSize.width, (int32_t)sensorSize.height,
1000
};
cm.update(ANDROID_CONTROL_AE_REGIONS, controlAeRegions, NELEM(controlAeRegions));
cm.update(ANDROID_CONTROL_AWB_REGIONS, controlAeRegions, NELEM(controlAeRegions));
cm.update(ANDROID_CONTROL_AF_REGIONS, controlAeRegions, NELEM(controlAeRegions));
static const int32_t controlAeExposureCompensation = 0;
cm.update(ANDROID_CONTROL_AE_EXPOSURE_COMPENSATION, &controlAeExposureCompensation, 1);
static const int32_t controlAeTargetFpsRange[] = {
10, 20
};
cm.update(ANDROID_CONTROL_AE_TARGET_FPS_RANGE, controlAeTargetFpsRange, NELEM(controlAeTargetFpsRange));
static const uint8_t controlAeAntibandingMode = ANDROID_CONTROL_AE_ANTIBANDING_MODE_OFF;
cm.update(ANDROID_CONTROL_AE_ANTIBANDING_MODE, &controlAeAntibandingMode, 1);
static const uint8_t controlAwbMode = ANDROID_CONTROL_AWB_MODE_OFF;
cm.update(ANDROID_CONTROL_AWB_MODE, &controlAwbMode, 1);
static const uint8_t controlAwbLock = ANDROID_CONTROL_AWB_LOCK_OFF;
cm.update(ANDROID_CONTROL_AWB_LOCK, &controlAwbLock, 1);
uint8_t controlAfMode = ANDROID_CONTROL_AF_MODE_OFF;
cm.update(ANDROID_CONTROL_AF_MODE, &controlAfMode, 1);
static const uint8_t controlAeState = ANDROID_CONTROL_AE_STATE_CONVERGED;
cm.update(ANDROID_CONTROL_AE_STATE, &controlAeState, 1);
static const uint8_t controlAfState = ANDROID_CONTROL_AF_STATE_INACTIVE;
cm.update(ANDROID_CONTROL_AF_STATE, &controlAfState, 1);
static const uint8_t controlAwbState = ANDROID_CONTROL_AWB_STATE_INACTIVE;
cm.update(ANDROID_CONTROL_AWB_STATE, &controlAwbState, 1);
static const uint8_t controlVideoStabilizationMode = ANDROID_CONTROL_VIDEO_STABILIZATION_MODE_OFF;
cm.update(ANDROID_CONTROL_VIDEO_STABILIZATION_MODE, &controlVideoStabilizationMode, 1);
static const int32_t controlAePrecaptureId = ANDROID_CONTROL_AE_PRECAPTURE_TRIGGER_IDLE;
cm.update(ANDROID_CONTROL_AE_PRECAPTURE_ID, &controlAePrecaptureId, 1);
static const int32_t controlAfTriggerId = 0;
cm.update(ANDROID_CONTROL_AF_TRIGGER_ID, &controlAfTriggerId, 1);
mDefaultRequestSettings[type] = cm.release();
return mDefaultRequestSettings[type];
}
int Camera::configureStreams(camera3_stream_configuration_t *streamList) {
DBGUTILS_AUTOLOGCALL(__func__);
Mutex::Autolock lock(mMutex);
ALOGI("configureStreams");
/* TODO: sanity checks */
ALOGI("+-------------------------------------------------------------------------------");
ALOGI("| STREAMS FROM FRAMEWORK");
ALOGI("+-------------------------------------------------------------------------------");
for(size_t i = 0; i < streamList->num_streams; ++i) {
camera3_stream_t *newStream = streamList->streams[i];
ALOGI("| p=%p fmt=0x%.2x type=%u usage=0x%.8x size=%4ux%-4u buf_no=%u",
newStream,
newStream->format,
newStream->stream_type,
newStream->usage,
newStream->width,
newStream->height,
newStream->max_buffers);
}
ALOGI("+-------------------------------------------------------------------------------");
/* TODO: do we need input stream? */
camera3_stream_t *inStream = NULL;
unsigned width = 0;
unsigned height = 0;
for(size_t i = 0; i < streamList->num_streams; ++i) {
camera3_stream_t *newStream = streamList->streams[i];
/* TODO: validate: null */
if(newStream->stream_type == CAMERA3_STREAM_INPUT || newStream->stream_type == CAMERA3_STREAM_BIDIRECTIONAL) {
if(inStream) {
ALOGI("Only one input/bidirectional stream allowed (previous is %p, this %p)", inStream, newStream);
return BAD_VALUE;
}
inStream = newStream;
}
/* TODO: validate format */
if(newStream->format == HAL_PIXEL_FORMAT_IMPLEMENTATION_DEFINED) {
newStream->format = HAL_PIXEL_FORMAT_RGBA_8888;
}
/* TODO: support ZSL */
if(newStream->usage & GRALLOC_USAGE_HW_CAMERA_ZSL) {
ALOGI("ZSL STREAM FOUND! It is not supported for now.");
ALOGI(" Disable it by placing following line in /system/build.prop:");
ALOGI(" camera.disable_zsl_mode=1");
return BAD_VALUE;
}
switch(newStream->stream_type) {
case CAMERA3_STREAM_OUTPUT: newStream->usage = GRALLOC_USAGE_SW_WRITE_OFTEN; break;
case CAMERA3_STREAM_INPUT: newStream->usage = GRALLOC_USAGE_SW_READ_OFTEN; break;
case CAMERA3_STREAM_BIDIRECTIONAL: newStream->usage = GRALLOC_USAGE_SW_WRITE_OFTEN | GRALLOC_USAGE_SW_READ_OFTEN; break;
}
newStream->max_buffers = 1; /* TODO: support larger queue */
if(newStream->width * newStream->height > width * height) {
width = newStream->width;
height = newStream->height;
}
/* TODO: store stream pointers somewhere and configure only new ones */
}
if(mDev->isNeedsetResolution(width, height))
{
if(mDev->isStreaming())
{
if (!mDev->setStreaming(false))
{
ALOGI("Could not stop streaming");
return NO_INIT;
}
}
if (!mDev->setResolution(width, height))
{
ALOGI("Could not set resolution");
return NO_INIT;
}
}
ALOGI("+-------------------------------------------------------------------------------");
ALOGI("| STREAMS AFTER CHANGES");
ALOGI("+-------------------------------------------------------------------------------");
for(size_t i = 0; i < streamList->num_streams; ++i) {
const camera3_stream_t *newStream = streamList->streams[i];
ALOGI("| p=%p fmt=0x%.2x type=%u usage=0x%.8x size=%4ux%-4u buf_no=%u",
newStream,
newStream->format,
newStream->stream_type,
newStream->usage,
newStream->width,
newStream->height,
newStream->max_buffers);
}
ALOGI("+-------------------------------------------------------------------------------");
if(!mDev->setStreaming(true)) {
ALOGI("Could not start streaming");
return NO_INIT;
}
return NO_ERROR;
}
int Camera::registerStreamBuffers(const camera3_stream_buffer_set_t *bufferSet) {
DBGUTILS_AUTOLOGCALL(__func__);
Mutex::Autolock lock(mMutex);
ALOGI("+-------------------------------------------------------------------------------");
ALOGI("| BUFFERS FOR STREAM %p", bufferSet->stream);
ALOGI("+-------------------------------------------------------------------------------");
for (size_t i = 0; i < bufferSet->num_buffers; ++i) {
ALOGI("| p=%p", bufferSet->buffers[i]);
}
ALOGI("+-------------------------------------------------------------------------------");
return OK;
}
int Camera::processCaptureRequest(camera3_capture_request_t *request) {
assert(request != NULL);
Mutex::Autolock lock(mMutex);
BENCHMARK_HERE(120);
FPSCOUNTER_HERE(120);
CameraMetadata cm;
const V4l2Device::VBuffer *frame = NULL;
auto res = mDev->resolution();
status_t e;
Vector<camera3_stream_buffer> buffers;
auto timestamp = systemTime();
if(request->settings == NULL && mLastRequestSettings.isEmpty()) {
ALOGI("processCaptureRequest error 1, First request does not have metadata, BAD_VALUE is %d", BAD_VALUE);
return BAD_VALUE;
}
if(request->input_buffer) {
/* Ignore input buffer */
/* TODO: do we expect any input buffer? */
request->input_buffer->release_fence = -1;
}
if(!request->settings) {
cm.acquire(mLastRequestSettings);
} else {
cm = request->settings;
}
notifyShutter(request->frame_number, (uint64_t)timestamp);
BENCHMARK_SECTION("Lock/Read") {
frame = mDev->readLock();
}
if(!frame) {
ALOGI("processCaptureRequest error 2, NOT_ENOUGH_DATA is %d", NOT_ENOUGH_DATA);
return NOT_ENOUGH_DATA;
}
buffers.setCapacity(request->num_output_buffers);
uint8_t *rgbaBuffer = NULL;
char aviRecordering[PROPERTY_VALUE_MAX];
for(size_t i = 0; i < request->num_output_buffers; ++i) {
const camera3_stream_buffer &srcBuf = request->output_buffers[i];
uint8_t *buf = NULL;
sp<Fence> acquireFence = new Fence(srcBuf.acquire_fence);
e = acquireFence->wait(1500); /* FIXME: magic number */
if(e == TIMED_OUT) {
ALOGI("processCaptureRequest buffer %p frame %-4u Wait on acquire fence timed out", srcBuf.buffer, request->frame_number);
}
if(e == NO_ERROR) {
const Rect rect((int)srcBuf.stream->width, (int)srcBuf.stream->height);
e = GraphicBufferMapper::get().lock(*srcBuf.buffer, GRALLOC_USAGE_SW_WRITE_OFTEN, rect, (void **)&buf);
if(e != NO_ERROR) {
ALOGI("processCaptureRequest buffer %p frame %-4u lock failed", srcBuf.buffer, request->frame_number);
}
}
if(e != NO_ERROR) {
ALOGI("processCaptureRequest error 3, e is %d, errno is %d, acquire_fence is %d", e, errno, srcBuf.acquire_fence);
do GraphicBufferMapper::get().unlock(*request->output_buffers[i].buffer); while(i--);
return NO_INIT;
}
switch(srcBuf.stream->format) {
case HAL_PIXEL_FORMAT_RGBA_8888: {
if(!rgbaBuffer) {
BENCHMARK_SECTION("YUV->RGBA") {
/* FIXME: better format detection */
if(frame->pixFmt == V4L2_PIX_FMT_YUYV) {
//mConverter.UYVYToRGBA(frame->buf, buf, res.width, res.height);
libyuv::YUY2ToI422(frame->buf, res.width*2,
mFrameBuffer, res.width,
&mFrameBuffer[res.width*res.height], res.width / 2,
&mFrameBuffer[res.width*res.height + res.width*res.height / 2], res.width / 2,
res.width, res.height);
_AddTimesTamp(mFrameBuffer, res.width, res.height);
libyuv::I422ToABGR(mFrameBuffer, res.width,
&mFrameBuffer[res.width*res.height], res.width / 2,
&mFrameBuffer[res.width*res.height + res.width*res.height / 2], res.width / 2,
buf,res.width*4,
res.width, res.height);
} else if (frame->pixFmt == V4L2_PIX_FMT_MJPEG) {
libyuv::MJPGToI420(frame->buf, frame->len,
rszbuffer, res.width,
&rszbuffer[res.width * res.height], res.width / 2 ,
&rszbuffer[res.width * res.height * 5 / 4 ], res.width / 2 ,
res.width, res.height,
res.width, res.height);
_AddTimesTamp(rszbuffer, res.width, res.height);
libyuv::I420ToABGR(rszbuffer, res.width,
&rszbuffer[res.width * res.height], res.width / 2 ,
&rszbuffer[res.width * res.height * 5 / 4 ], res.width / 2 ,
buf, res.width*4,
res.width, res.height);
// ALOGI("%s, MJPG convert done!", __FUNCTION__);
} else {
;//mConverter.YUY2ToRGBA(frame->buf, buf, res.width, res.height);
}
rgbaBuffer = buf;
}
} else {
BENCHMARK_SECTION("Buf Copy") {
memcpy(buf, rgbaBuffer, srcBuf.stream->width * srcBuf.stream->height * 4);
}
}
break;
}
case HAL_PIXEL_FORMAT_BLOB: {
BENCHMARK_SECTION("YUV->JPEG") {
const size_t maxImageSize = mJpegBufferSize - sizeof(camera3_jpeg_blob);
uint8_t jpegQuality = 95;
if(cm.exists(ANDROID_JPEG_QUALITY)) {
jpegQuality = *cm.find(ANDROID_JPEG_QUALITY).data.u8;
}
ALOGI("JPEG quality = %u", jpegQuality);
/* FIXME: better format detection */
uint8_t *bufEnd = NULL;
if(frame->pixFmt == V4L2_PIX_FMT_UYVY)
{
ALOGI("processCaptureRequest HAL_PIXEL_FORMAT_BLOB frame->pixFmt == V4L2_PIX_FMT_UYVY");
// bufEnd = mConverter.UYVYToJPEG(frame->buf, buf, res.width, res.height, maxImageSize, jpegQuality);
}
else if (frame->pixFmt == V4L2_PIX_FMT_MJPEG) {
ALOGI("processCaptureRequest HAL_PIXEL_FORMAT_BLOB frame->pixFmt == V4L2_PIX_FMT_MJPEG");
int count = frame->len / mPageSize;
int mod = frame->len % mPageSize;
uint8_t *destbuf = buf;
uint8_t * srcBuf = frame->buf;
for(int i=0; i<count; ++i)
{
memcpy(destbuf, srcBuf, mPageSize);
destbuf += mPageSize;
srcBuf += mPageSize;
}
if(mod != 0)
{
memcpy(destbuf, srcBuf, mod);
}
//memcpy(buf, frame->buf, frame->len);
bufEnd = buf + frame->len;
} else
{
ALOGI("processCaptureRequest HAL_PIXEL_FORMAT_BLOB YUY2ToJPEG");
// bufEnd = mConverter.YUY2ToJPEG(frame->buf, buf, res.width, res.height, maxImageSize, jpegQuality);
}
if(bufEnd != buf) {
camera3_jpeg_blob *jpegBlob = reinterpret_cast<camera3_jpeg_blob*>(buf + maxImageSize);
jpegBlob->jpeg_blob_id = CAMERA3_JPEG_BLOB_ID;
jpegBlob->jpeg_size = (uint32_t)(bufEnd - buf);
} else {
ALOGI("%s: JPEG image too big!", __FUNCTION__);
}
}
break;
}
default:
ALOGI("Unknown pixel format %d in buffer %p (stream %p), ignoring", srcBuf.stream->format, srcBuf.buffer, srcBuf.stream);
}
}
/* Unlocking all buffers in separate loop allows to copy data from already processed buffer to not yet processed one */
for(size_t i = 0; i < request->num_output_buffers; ++i) {
const camera3_stream_buffer &srcBuf = request->output_buffers[i];
GraphicBufferMapper::get().unlock(*srcBuf.buffer);
buffers.push_back(srcBuf);
buffers.editTop().acquire_fence = -1;
buffers.editTop().release_fence = -1;
buffers.editTop().status = CAMERA3_BUFFER_STATUS_OK;
}
BENCHMARK_SECTION("Unlock") {
mDev->unlock(frame);
}
int64_t sensorTimestamp = timestamp;
int64_t syncFrameNumber = request->frame_number;
cm.update(ANDROID_SENSOR_TIMESTAMP, &sensorTimestamp, 1);
cm.update(ANDROID_SYNC_FRAME_NUMBER, &syncFrameNumber, 1);
auto result = cm.getAndLock();
processCaptureResult(request->frame_number, result, buffers);
cm.unlock(result);
// Cache the settings for next time
mLastRequestSettings.acquire(cm);
/* Print stats */
char bmOut[1024];
BENCHMARK_STRING(bmOut, sizeof(bmOut), 6);
// ALOGI(" time (avg): %s", bmOut);
// ALOGI("processCaptureRequest no error");
return NO_ERROR;
}
inline void Camera::notifyShutter(uint32_t frameNumber, uint64_t timestamp) {
camera3_notify_msg_t msg;
msg.type = CAMERA3_MSG_SHUTTER;
msg.message.shutter.frame_number = frameNumber;
msg.message.shutter.timestamp = timestamp;
mCallbackOps->notify(mCallbackOps, &msg);
}
void Camera::processCaptureResult(uint32_t frameNumber, const camera_metadata_t *result, const Vector<camera3_stream_buffer> &buffers) {
camera3_capture_result captureResult;
captureResult.frame_number = frameNumber;
captureResult.result = result;
captureResult.num_output_buffers = buffers.size();
captureResult.output_buffers = buffers.array();
captureResult.input_buffer = NULL;
captureResult.partial_result = 0;
mCallbackOps->process_capture_result(mCallbackOps, &captureResult);
}
/******************************************************************************\
STATIC WRAPPERS
\******************************************************************************/
int Camera::sClose(hw_device_t *device) {
/* TODO: check device module */
Camera *thiz = static_cast<Camera *>(reinterpret_cast<camera3_device_t *>(device));
return thiz->closeDevice();
}
int Camera::sInitialize(const camera3_device *device, const camera3_callback_ops_t *callback_ops) {
/* TODO: check pointers */
Camera *thiz = static_cast<Camera *>(const_cast<camera3_device *>(device));
return thiz->initialize(callback_ops);
}
int Camera::sConfigureStreams(const camera3_device *device, camera3_stream_configuration_t *stream_list) {
/* TODO: check pointers */
Camera *thiz = static_cast<Camera *>(const_cast<camera3_device *>(device));
return thiz->configureStreams(stream_list);
}
int Camera::sRegisterStreamBuffers(const camera3_device *device, const camera3_stream_buffer_set_t *buffer_set) {
/* TODO: check pointers */
Camera *thiz = static_cast<Camera *>(const_cast<camera3_device *>(device));
return thiz->registerStreamBuffers(buffer_set);
}
const camera_metadata_t * Camera::sConstructDefaultRequestSettings(const camera3_device *device, int type) {
/* TODO: check pointers */
Camera *thiz = static_cast<Camera *>(const_cast<camera3_device *>(device));
return thiz->constructDefaultRequestSettings(type);
}
int Camera::sProcessCaptureRequest(const camera3_device *device, camera3_capture_request_t *request) {
/* TODO: check pointers */
Camera *thiz = static_cast<Camera *>(const_cast<camera3_device *>(device));
return thiz->processCaptureRequest(request);
}
void Camera::sGetMetadataVendorTagOps(const camera3_device *device, vendor_tag_query_ops_t *ops) {
/* TODO: implement */
}
void Camera::sDump(const camera3_device *device, int fd) {
/* TODO: implement */
}
int Camera::sFlush(const camera3_device *device) {
/* TODO: implement */
return NO_ERROR;//-ENODEV;
}
camera3_device_ops_t Camera::sOps = {
.initialize = Camera::sInitialize,
.configure_streams = Camera::sConfigureStreams,
.register_stream_buffers = Camera::sRegisterStreamBuffers,
.construct_default_request_settings = Camera::sConstructDefaultRequestSettings,
.process_capture_request = Camera::sProcessCaptureRequest,
.get_metadata_vendor_tag_ops = Camera::sGetMetadataVendorTagOps,
.dump = Camera::sDump,
.flush = Camera::sFlush,
.reserved = {0}
};
}; /* namespace android */
大家请注意，在Camera.cpp的Camera()里调用了common.version = CAMERA_DEVICE_API_VERSION_3_2; 在cameraInfo里调用了info->device_version = CAMERA_DEVICE_API_VERSION_3_2; 这里表示，我们的hal的版本定义为了hal3.2。
我们的HalModule.cpp的get_camera_info指向了HalModule::getCameraInfo， getCameraInfo里又调用到了Camera::cameraInfo，然后Camera::cameraInfo通过staticCharacteristics来，获取我们usbcamera的属性。这样在app上就可以通过getCameraInfo来获取我们usbcamera的属性了。也可以使用下面的方法来获取我们预览或者拍尺寸等：
public List<Size> getSupportedPreviewSizes() {
StreamConfigurationMap configMap;
CameraCharacteristics mCameraCharacteristics;
try {
configMap = mCameraCharacteristics.get(
CameraCharacteristics.SCALER_STREAM_CONFIGURATION_MAP);
} catch (Exception ex) {
return new ArrayList<>(0);
}
ArrayList<Size> supportedPictureSizes = new ArrayList<>();
for (android.util.Size androidSize : configMap.getOutputSizes(SurfaceTexture.class)) {
supportedPictureSizes.add(new Size(androidSize));
}
return supportedPictureSizes;
}
我这个usbcamera，可以同时兼容api1和api2，当然，如果想要让api2也来调用的话，camera_metadata_t *mStaticCharacteristics;这个值要配好，必须按api2的规范来，该有的值一个都不能少，要不然app在调用getStreamConfigurationMap去获取属性时，就有可能会因为获取不到对应的值而报错。
比如一开始，我在staticCharacteristics这个函数里，没有配置ANDROID_REQUEST_AVAILABLE_CAPABILITIES相关的属性。然后app在用api2的接口去getStreamConfigurationMap的时候，就因为找不到REQUEST_AVAILABLE_CAPABILITIES而报错了。至于api2都需要哪些配置项，大家可以参考frameworks\base\core\java\android\hardware\camera2\impl\CameraMetadataNative.java里的getStreamConfigurationMap()这个函数，这里需要的，都给加上，都必须加上。
后来报错后，我在staticCharacteristics这个函数里，加下了如下代码，就可以了：
Vector<uint8_t> available_capabilities;
available_capabilities.add(ANDROID_REQUEST_AVAILABLE_CAPABILITIES_READ_SENSOR_SETTINGS);
available_capabilities.add(ANDROID_REQUEST_AVAILABLE_CAPABILITIES_PRIVATE_REPROCESSING);
available_capabilities.add(ANDROID_REQUEST_AVAILABLE_CAPABILITIES_YUV_REPROCESSING);
cm.update(ANDROID_REQUEST_AVAILABLE_CAPABILITIES,
available_capabilities.array(),
available_capabilities.size());
到这里，我们一个完整的usbcamera hal就添加完成了。当然，虚拟摄像头也是一样的。唯一不同的是camera.cpp里的processCaptureRequest这个函数。我们的usbcamera是真正的一个摄像头，是可以取到实景的，所以就按照v4l2的标准来读取，然后按camera hal的规范来填充就可以。 但是虚拟摄像头因为是没有真正的摄像头的，它取的景，是底层事先录好一个视频，然后喂给buff的。所以虚拟摄像头，需要修改processCaptureRequest这个函数。
虚拟摄像头，只需要在这个函数里，按照app设置的帧率来循环读取视频里的数据，然后abgr的格式，喂给processCaptureResult这个函数，这个函数，再通过回调mCallbackOps->process_capture_result，返回给上面即可。
来源：oschina
链接：https://my.oschina.net/u/4288355/blog/4436889