Back to home page

OSCL-LXR

 
 

    


0001 .. SPDX-License-Identifier: GPL-2.0
0002 
0003 Video device' s internal representation
0004 =======================================
0005 
0006 The actual device nodes in the ``/dev`` directory are created using the
0007 :c:type:`video_device` struct (``v4l2-dev.h``). This struct can either be
0008 allocated dynamically or embedded in a larger struct.
0009 
0010 To allocate it dynamically use :c:func:`video_device_alloc`:
0011 
0012 .. code-block:: c
0013 
0014         struct video_device *vdev = video_device_alloc();
0015 
0016         if (vdev == NULL)
0017                 return -ENOMEM;
0018 
0019         vdev->release = video_device_release;
0020 
0021 If you embed it in a larger struct, then you must set the ``release()``
0022 callback to your own function:
0023 
0024 .. code-block:: c
0025 
0026         struct video_device *vdev = &my_vdev->vdev;
0027 
0028         vdev->release = my_vdev_release;
0029 
0030 The ``release()`` callback must be set and it is called when the last user
0031 of the video device exits.
0032 
0033 The default :c:func:`video_device_release` callback currently
0034 just calls ``kfree`` to free the allocated memory.
0035 
0036 There is also a :c:func:`video_device_release_empty` function that does
0037 nothing (is empty) and should be used if the struct is embedded and there
0038 is nothing to do when it is released.
0039 
0040 You should also set these fields of :c:type:`video_device`:
0041 
0042 - :c:type:`video_device`->v4l2_dev: must be set to the :c:type:`v4l2_device`
0043   parent device.
0044 
0045 - :c:type:`video_device`->name: set to something descriptive and unique.
0046 
0047 - :c:type:`video_device`->vfl_dir: set this to ``VFL_DIR_RX`` for capture
0048   devices (``VFL_DIR_RX`` has value 0, so this is normally already the
0049   default), set to ``VFL_DIR_TX`` for output devices and ``VFL_DIR_M2M`` for mem2mem (codec) devices.
0050 
0051 - :c:type:`video_device`->fops: set to the :c:type:`v4l2_file_operations`
0052   struct.
0053 
0054 - :c:type:`video_device`->ioctl_ops: if you use the :c:type:`v4l2_ioctl_ops`
0055   to simplify ioctl maintenance (highly recommended to use this and it might
0056   become compulsory in the future!), then set this to your
0057   :c:type:`v4l2_ioctl_ops` struct. The :c:type:`video_device`->vfl_type and
0058   :c:type:`video_device`->vfl_dir fields are used to disable ops that do not
0059   match the type/dir combination. E.g. VBI ops are disabled for non-VBI nodes,
0060   and output ops  are disabled for a capture device. This makes it possible to
0061   provide just one :c:type:`v4l2_ioctl_ops` struct for both vbi and
0062   video nodes.
0063 
0064 - :c:type:`video_device`->lock: leave to ``NULL`` if you want to do all the
0065   locking  in the driver. Otherwise you give it a pointer to a struct
0066   ``mutex_lock`` and before the :c:type:`video_device`->unlocked_ioctl
0067   file operation is called this lock will be taken by the core and released
0068   afterwards. See the next section for more details.
0069 
0070 - :c:type:`video_device`->queue: a pointer to the struct vb2_queue
0071   associated with this device node.
0072   If queue is not ``NULL``, and queue->lock is not ``NULL``, then queue->lock
0073   is used for the queuing ioctls (``VIDIOC_REQBUFS``, ``CREATE_BUFS``,
0074   ``QBUF``, ``DQBUF``,  ``QUERYBUF``, ``PREPARE_BUF``, ``STREAMON`` and
0075   ``STREAMOFF``) instead of the lock above.
0076   That way the :ref:`vb2 <vb2_framework>` queuing framework does not have
0077   to wait for other ioctls.   This queue pointer is also used by the
0078   :ref:`vb2 <vb2_framework>` helper functions to check for
0079   queuing ownership (i.e. is the filehandle calling it allowed to do the
0080   operation).
0081 
0082 - :c:type:`video_device`->prio: keeps track of the priorities. Used to
0083   implement ``VIDIOC_G_PRIORITY`` and ``VIDIOC_S_PRIORITY``.
0084   If left to ``NULL``, then it will use the struct v4l2_prio_state
0085   in :c:type:`v4l2_device`. If you want to have a separate priority state per
0086   (group of) device node(s),   then you can point it to your own struct
0087   :c:type:`v4l2_prio_state`.
0088 
0089 - :c:type:`video_device`->dev_parent: you only set this if v4l2_device was
0090   registered with ``NULL`` as the parent ``device`` struct. This only happens
0091   in cases where one hardware device has multiple PCI devices that all share
0092   the same :c:type:`v4l2_device` core.
0093 
0094   The cx88 driver is an example of this: one core :c:type:`v4l2_device` struct,
0095   but   it is used by both a raw video PCI device (cx8800) and a MPEG PCI device
0096   (cx8802). Since the :c:type:`v4l2_device` cannot be associated with two PCI
0097   devices at the same time it is setup without a parent device. But when the
0098   struct video_device is initialized you **do** know which parent
0099   PCI device to use and so you set ``dev_device`` to the correct PCI device.
0100 
0101 If you use :c:type:`v4l2_ioctl_ops`, then you should set
0102 :c:type:`video_device`->unlocked_ioctl to :c:func:`video_ioctl2` in your
0103 :c:type:`v4l2_file_operations` struct.
0104 
0105 In some cases you want to tell the core that a function you had specified in
0106 your :c:type:`v4l2_ioctl_ops` should be ignored. You can mark such ioctls by
0107 calling this function before :c:func:`video_register_device` is called:
0108 
0109         :c:func:`v4l2_disable_ioctl <v4l2_disable_ioctl>`
0110         (:c:type:`vdev <video_device>`, cmd).
0111 
0112 This tends to be needed if based on external factors (e.g. which card is
0113 being used) you want to turns off certain features in :c:type:`v4l2_ioctl_ops`
0114 without having to make a new struct.
0115 
0116 The :c:type:`v4l2_file_operations` struct is a subset of file_operations.
0117 The main difference is that the inode argument is omitted since it is never
0118 used.
0119 
0120 If integration with the media framework is needed, you must initialize the
0121 :c:type:`media_entity` struct embedded in the :c:type:`video_device` struct
0122 (entity field) by calling :c:func:`media_entity_pads_init`:
0123 
0124 .. code-block:: c
0125 
0126         struct media_pad *pad = &my_vdev->pad;
0127         int err;
0128 
0129         err = media_entity_pads_init(&vdev->entity, 1, pad);
0130 
0131 The pads array must have been previously initialized. There is no need to
0132 manually set the struct media_entity type and name fields.
0133 
0134 A reference to the entity will be automatically acquired/released when the
0135 video device is opened/closed.
0136 
0137 ioctls and locking
0138 ------------------
0139 
0140 The V4L core provides optional locking services. The main service is the
0141 lock field in struct video_device, which is a pointer to a mutex.
0142 If you set this pointer, then that will be used by unlocked_ioctl to
0143 serialize all ioctls.
0144 
0145 If you are using the :ref:`videobuf2 framework <vb2_framework>`, then there
0146 is a second lock that you can set: :c:type:`video_device`->queue->lock. If
0147 set, then this lock will be used instead of :c:type:`video_device`->lock
0148 to serialize all queuing ioctls (see the previous section
0149 for the full list of those ioctls).
0150 
0151 The advantage of using a different lock for the queuing ioctls is that for some
0152 drivers (particularly USB drivers) certain commands such as setting controls
0153 can take a long time, so you want to use a separate lock for the buffer queuing
0154 ioctls. That way your ``VIDIOC_DQBUF`` doesn't stall because the driver is busy
0155 changing the e.g. exposure of the webcam.
0156 
0157 Of course, you can always do all the locking yourself by leaving both lock
0158 pointers at ``NULL``.
0159 
0160 If you use the old :ref:`videobuf framework <vb_framework>` then you must
0161 pass the :c:type:`video_device`->lock to the videobuf queue initialize
0162 function: if videobuf has to wait for a frame to arrive, then it will
0163 temporarily unlock the lock and relock it afterwards. If your driver also
0164 waits in the code, then you should do the same to allow other
0165 processes to access the device node while the first process is waiting for
0166 something.
0167 
0168 In the case of :ref:`videobuf2 <vb2_framework>` you will need to implement the
0169 ``wait_prepare()`` and ``wait_finish()`` callbacks to unlock/lock if applicable.
0170 If you use the ``queue->lock`` pointer, then you can use the helper functions
0171 :c:func:`vb2_ops_wait_prepare` and :c:func:`vb2_ops_wait_finish`.
0172 
0173 The implementation of a hotplug disconnect should also take the lock from
0174 :c:type:`video_device` before calling v4l2_device_disconnect. If you are also
0175 using :c:type:`video_device`->queue->lock, then you have to first lock
0176 :c:type:`video_device`->queue->lock followed by :c:type:`video_device`->lock.
0177 That way you can be sure no ioctl is running when you call
0178 :c:func:`v4l2_device_disconnect`.
0179 
0180 Video device registration
0181 -------------------------
0182 
0183 Next you register the video device with :c:func:`video_register_device`.
0184 This will create the character device for you.
0185 
0186 .. code-block:: c
0187 
0188         err = video_register_device(vdev, VFL_TYPE_VIDEO, -1);
0189         if (err) {
0190                 video_device_release(vdev); /* or kfree(my_vdev); */
0191                 return err;
0192         }
0193 
0194 If the :c:type:`v4l2_device` parent device has a not ``NULL`` mdev field,
0195 the video device entity will be automatically registered with the media
0196 device.
0197 
0198 Which device is registered depends on the type argument. The following
0199 types exist:
0200 
0201 ========================== ====================  ==============================
0202 :c:type:`vfl_devnode_type` Device name           Usage
0203 ========================== ====================  ==============================
0204 ``VFL_TYPE_VIDEO``         ``/dev/videoX``       for video input/output devices
0205 ``VFL_TYPE_VBI``           ``/dev/vbiX``         for vertical blank data (i.e.
0206                                                  closed captions, teletext)
0207 ``VFL_TYPE_RADIO``         ``/dev/radioX``       for radio tuners
0208 ``VFL_TYPE_SUBDEV``        ``/dev/v4l-subdevX``  for V4L2 subdevices
0209 ``VFL_TYPE_SDR``           ``/dev/swradioX``     for Software Defined Radio
0210                                                  (SDR) tuners
0211 ``VFL_TYPE_TOUCH``         ``/dev/v4l-touchX``   for touch sensors
0212 ========================== ====================  ==============================
0213 
0214 The last argument gives you a certain amount of control over the device
0215 node number used (i.e. the X in ``videoX``). Normally you will pass -1
0216 to let the v4l2 framework pick the first free number. But sometimes users
0217 want to select a specific node number. It is common that drivers allow
0218 the user to select a specific device node number through a driver module
0219 option. That number is then passed to this function and video_register_device
0220 will attempt to select that device node number. If that number was already
0221 in use, then the next free device node number will be selected and it
0222 will send a warning to the kernel log.
0223 
0224 Another use-case is if a driver creates many devices. In that case it can
0225 be useful to place different video devices in separate ranges. For example,
0226 video capture devices start at 0, video output devices start at 16.
0227 So you can use the last argument to specify a minimum device node number
0228 and the v4l2 framework will try to pick the first free number that is equal
0229 or higher to what you passed. If that fails, then it will just pick the
0230 first free number.
0231 
0232 Since in this case you do not care about a warning about not being able
0233 to select the specified device node number, you can call the function
0234 :c:func:`video_register_device_no_warn` instead.
0235 
0236 Whenever a device node is created some attributes are also created for you.
0237 If you look in ``/sys/class/video4linux`` you see the devices. Go into e.g.
0238 ``video0`` and you will see 'name', 'dev_debug' and 'index' attributes. The
0239 'name' attribute is the 'name' field of the video_device struct. The
0240 'dev_debug' attribute can be used to enable core debugging. See the next
0241 section for more detailed information on this.
0242 
0243 The 'index' attribute is the index of the device node: for each call to
0244 :c:func:`video_register_device()` the index is just increased by 1. The
0245 first video device node you register always starts with index 0.
0246 
0247 Users can setup udev rules that utilize the index attribute to make fancy
0248 device names (e.g. '``mpegX``' for MPEG video capture device nodes).
0249 
0250 After the device was successfully registered, then you can use these fields:
0251 
0252 - :c:type:`video_device`->vfl_type: the device type passed to
0253   :c:func:`video_register_device`.
0254 - :c:type:`video_device`->minor: the assigned device minor number.
0255 - :c:type:`video_device`->num: the device node number (i.e. the X in
0256   ``videoX``).
0257 - :c:type:`video_device`->index: the device index number.
0258 
0259 If the registration failed, then you need to call
0260 :c:func:`video_device_release` to free the allocated :c:type:`video_device`
0261 struct, or free your own struct if the :c:type:`video_device` was embedded in
0262 it. The ``vdev->release()`` callback will never be called if the registration
0263 failed, nor should you ever attempt to unregister the device if the
0264 registration failed.
0265 
0266 video device debugging
0267 ----------------------
0268 
0269 The 'dev_debug' attribute that is created for each video, vbi, radio or swradio
0270 device in ``/sys/class/video4linux/<devX>/`` allows you to enable logging of
0271 file operations.
0272 
0273 It is a bitmask and the following bits can be set:
0274 
0275 .. tabularcolumns:: |p{5ex}|L|
0276 
0277 ===== ================================================================
0278 Mask  Description
0279 ===== ================================================================
0280 0x01  Log the ioctl name and error code. VIDIOC_(D)QBUF ioctls are
0281       only logged if bit 0x08 is also set.
0282 0x02  Log the ioctl name arguments and error code. VIDIOC_(D)QBUF
0283       ioctls are
0284       only logged if bit 0x08 is also set.
0285 0x04  Log the file operations open, release, read, write, mmap and
0286       get_unmapped_area. The read and write operations are only
0287       logged if bit 0x08 is also set.
0288 0x08  Log the read and write file operations and the VIDIOC_QBUF and
0289       VIDIOC_DQBUF ioctls.
0290 0x10  Log the poll file operation.
0291 0x20  Log error and messages in the control operations.
0292 ===== ================================================================
0293 
0294 Video device cleanup
0295 --------------------
0296 
0297 When the video device nodes have to be removed, either during the unload
0298 of the driver or because the USB device was disconnected, then you should
0299 unregister them with:
0300 
0301         :c:func:`video_unregister_device`
0302         (:c:type:`vdev <video_device>`);
0303 
0304 This will remove the device nodes from sysfs (causing udev to remove them
0305 from ``/dev``).
0306 
0307 After :c:func:`video_unregister_device` returns no new opens can be done.
0308 However, in the case of USB devices some application might still have one of
0309 these device nodes open. So after the unregister all file operations (except
0310 release, of course) will return an error as well.
0311 
0312 When the last user of the video device node exits, then the ``vdev->release()``
0313 callback is called and you can do the final cleanup there.
0314 
0315 Don't forget to cleanup the media entity associated with the video device if
0316 it has been initialized:
0317 
0318         :c:func:`media_entity_cleanup <media_entity_cleanup>`
0319         (&vdev->entity);
0320 
0321 This can be done from the release callback.
0322 
0323 
0324 helper functions
0325 ----------------
0326 
0327 There are a few useful helper functions:
0328 
0329 - file and :c:type:`video_device` private data
0330 
0331 You can set/get driver private data in the video_device struct using:
0332 
0333         :c:func:`video_get_drvdata <video_get_drvdata>`
0334         (:c:type:`vdev <video_device>`);
0335 
0336         :c:func:`video_set_drvdata <video_set_drvdata>`
0337         (:c:type:`vdev <video_device>`);
0338 
0339 Note that you can safely call :c:func:`video_set_drvdata` before calling
0340 :c:func:`video_register_device`.
0341 
0342 And this function:
0343 
0344         :c:func:`video_devdata <video_devdata>`
0345         (struct file \*file);
0346 
0347 returns the video_device belonging to the file struct.
0348 
0349 The :c:func:`video_devdata` function combines :c:func:`video_get_drvdata`
0350 with :c:func:`video_devdata`:
0351 
0352         :c:func:`video_drvdata <video_drvdata>`
0353         (struct file \*file);
0354 
0355 You can go from a :c:type:`video_device` struct to the v4l2_device struct using:
0356 
0357 .. code-block:: c
0358 
0359         struct v4l2_device *v4l2_dev = vdev->v4l2_dev;
0360 
0361 - Device node name
0362 
0363 The :c:type:`video_device` node kernel name can be retrieved using:
0364 
0365         :c:func:`video_device_node_name <video_device_node_name>`
0366         (:c:type:`vdev <video_device>`);
0367 
0368 The name is used as a hint by userspace tools such as udev. The function
0369 should be used where possible instead of accessing the video_device::num and
0370 video_device::minor fields.
0371 
0372 video_device functions and data structures
0373 ------------------------------------------
0374 
0375 .. kernel-doc:: include/media/v4l2-dev.h