PJPG Quantization table #1495

johnyradio · 2019-10-14T23:53:14Z

johnyradio
Oct 14, 2019

Reviewed guide and contributing documents? (Yes/No): YES
version [x.y.z, hash, other]: 4.2.2
installed as a package or compiled from sources [deb, rpm, git, other]: arch aur with pakku -S motion
standalone or part of third party [motion, MotionEyeOS, other]: standalone
video stream source [V4L (card or USB), net cam (mjpeg, rtsp, other), mmal]: V4L USB webcam
hardware [x86, ARM, other]: x86
operating system [16.04, Stretch, etc, FreeBSD, other]: arch linux

The cam make/model is JWIN JC-AM100. I believe it's the 2nd Pixart device here:

$ lsusb
Bus 002 Device 004: ID 0bda:0158 Realtek Semiconductor Corp. USB 2.0 multicard reader
Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 007 Device 021: ID 093a:2510 Pixart Imaging, Inc. Optical Mouse
Bus 007 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Bus 006 Device 002: ID 093a:2620 Pixart Imaging, Inc. 
Bus 006 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Bus 005 Device 003: ID 1a2c:2124 China Resource Semico Co., Ltd 
Bus 005 Device 002: ID 0451:1446 Texas Instruments, Inc. TUSB2040/2070 Hub
Bus 005 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Bus 001 Device 002: ID 0bda:8189 Realtek Semiconductor Corp. RTL8187B Wireless 802.11g 54Mbps Network Adapter
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 004 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Bus 003 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
[johny@myegg ~]$

It displays live video in the Qt V4L2 Test Utility, no problem. Qt V4L2 Test Utility reports the following about my webcam:

Device: /dev/video0 (wrapped)
Card: USB Camera (093a:2620)
Driver: gspca_pac7302
Bus: usb-0000:00:1d.1-1

Getting error:

$ motion
...
[1:ml1] [NTC] [VID] vid_start: Opening V4L2 device
[1:ml1] [NTC] [VID] v4l2_device_open: Using videodevice /dev/video0 and input -1
[1:ml1] [NTC] [VID] v4l2_device_capability: - VIDEO_CAPTURE
[1:ml1] [NTC] [VID] v4l2_device_capability: - READWRITE
[1:ml1] [NTC] [VID] v4l2_device_capability: - STREAMING
[1:ml1] [NTC] [VID] v4l2_input_select: Name = "gspca_pac7302"- CAMERA
[1:ml1] [NTC] [VID] v4l2_norm_select: Device does not support specifying PAL/NTSC norm
[1:ml1] [NTC] [VID] v4l2_pixfmt_select: Configuration palette index 17 (YU12) for 640x480 doesn't work.
...
[1:ml1] [NTC] [ALL] image_ring_resize: Resizing pre_capture buffer to 1 items
[1:ml1] [ERR] [ALL] jpgutl_error_exit: Quantization table 0x00 was not defined
[1:ml1] [CRT] [VID] vid_mjpegtoyuv420p: Corrupt image ... continue

Is this patch the fix?
http://www.lavrsen.dk/foswiki/bin/view/Motion/Libv4lConvert

Trying to install, got:

$ patch < libv4lconvert.patch
bash: libv4lconvert.patch: No such file or directory
[johny@myegg motion]$ ls
CONTRIBUTING.md    Makefile.am  configure.ac  doc                 man  scripts
ISSUE_TEMPLATE.md  README.md    data          libv4convert.patch  po   src
[johny@myegg motion]$ patch < libv4convert.patch 
can't find file to patch at input line 5
Perhaps you should have used the -p or --strip option?
The text leading up to this was:
--------------------------
|Index: configure.in
|===================================================================
|--- configure.in	(revision 467)
|+++ configure.in	(working copy)
--------------------------
File to patch:

Any help? thx!

Mr-Dave · 2019-10-15T02:33:57Z

Mr-Dave
Oct 15, 2019
Maintainer

Unfortunately, the log posted has the important bits snipped away. The key is the part after v4l2_pixfmt_select: Configuration palette index 17 (YU12) for 640x480 doesn't work. It will list out the supported formats.

Looking at which module it is complaining upon, I'm guessing that Motion went on and selected a MJPG format since the default did not work.

Historically this error only occurred with really old jpeg libraries from 14.04

The patch you referenced is not going to help given its age. First thing I would recommend is making sure that the JPEG lib installed is up to date (sorry, I don't use arch so I can't indicate how), then making sure that it is the only version installed and indicating in this issue what version it is.

For your reference, the solution to the previous problem was adding a guarantee_huff_tables which is still in there. Maybe for your camera, this line needs to be commented out(?)

Once we see the full log, we can also see if other formats are available or worst case, you can try the alternative webcam method using netcam_url

0 replies

johnyradio · 2019-10-15T17:53:05Z

johnyradio
Oct 15, 2019
Author

i'll check on the JPEG lib. Meantime, should i see guarantee_huff_tables in my .conf? Cuz i don't.
How can i generate the full log you requested? I think i sent everything i got.
i'm getting this:

$ v4l2-ctl -d /dev/video0 --list-formats
ioctl: VIDIOC_ENUM_FMT
	Type: Video Capture
	[0]: 'PJPG' (GSPCA PJPG, compressed)

$ ffplay  -pixel_format PJPG -f v4l2 /dev/video0
ffplay version n4.2.1 Copyright (c) 2003-2019 the FFmpeg developers
  built with gcc 9.1.0 (GCC)
  configuration: --prefix=/usr --disable-debug --disable-static --disable-stripping --enable-fontconfig --enable-gmp --enable-gnutls --enable-gpl --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libdav1d --enable-libdrm --enable-libfreetype --enable-libfribidi --enable-libgsm --enable-libiec61883 --enable-libjack --enable-libmodplug --enable-libmp3lame --enable-libopencore_amrnb --enable-libopencore_amrwb --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libv4l2 --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxcb --enable-libxml2 --enable-libxvid --enable-nvdec --enable-nvenc --enable-omx --enable-shared --enable-version3
  libavutil      56. 31.100 / 56. 31.100
  libavcodec     58. 54.100 / 58. 54.100
  libavformat    58. 29.100 / 58. 29.100
  libavdevice    58.  8.100 / 58.  8.100
  libavfilter     7. 57.100 /  7. 57.100
  libswscale      5.  5.100 /  5.  5.100
  libswresample   3.  5.100 /  3.  5.100
  libpostproc    55.  5.100 / 55.  5.100
[video4linux2,v4l2 @ 0x7fce0c000bc0] No such input format: PJPG.
/dev/video0: Invalid argument
    nan    :  0.000 fd=   0 aq=    0KB vq=    0KB sq=    0B f=0/0

This guy solved "Cannot find a proper format for codec 'none'" by setting LD_PRELOAD environment variable loading video4linux1 driver. Would that help my situation?
https://blog.stigok.com/2017/05/09/canyon-cnwcam21-webcam-with-ffmpeg.html
i put netcam_url in my .conf. Didn't seem to help.
My .conf is in ~/.motion/motion.conf
Here's my complete .conf:

##############################################################
# CUSTOM: 
##############################################################

# The full URL of the network camera stream.
; netcam_url v4l2:///dev/video0

# Output pictures when motion is detected
picture_output off

# for USB cam. But -1 is default anyway, so why do i need this?
input -1

############################################################
# Picture output configuration parameters
############################################################

# This config file was generated by motion 4.2.2
# Documentation:  /usr/share/doc/motion/motion_guide.html
#
# This file contains only the basic configuration options to get a
# system working.  There are many more options available.  Please
# consult the documentation for the complete list of all options.
#

############################################################
# System control configuration parameters
############################################################

# Start in daemon (background) mode and release terminal.
daemon off

# Start in Setup-Mode, daemon disabled.
setup_mode off

# File to store the process ID.
# ; pid_file value

# File to write logs messages into.  If not defined stderr and syslog is used.
# ; log_file value

# Level of log messages [1..9] (EMG, ALR, CRT, ERR, WRN, NTC, INF, DBG, ALL).
log_level 6

# Target directory for pictures, snapshots and movies
; target_dir /mnt/Docs/Videos/

# Video device (e.g. /dev/video0) to be used for capturing.
videodevice /dev/video0

# Camera control parameters (see raspivid/raspistill tool documentation)
# ; mmalcam_control_params value

############################################################
# Image Processing configuration parameters
############################################################

# Image width in pixels.
# width 640

# Image height in pixels.
# height 480

# Maximum number of frames to be captured per second.
framerate 3

# Text to be overlayed in the lower left corner of images
text_left JohnWeiss:Bedroom

# Text to be overlayed in the lower right corner of images.
text_right %Y-%m-%d\n%T-%q

############################################################
# Motion detection configuration parameters
############################################################

# Always save pictures and movies even if there was no motion.
emulate_motion off

# Threshold for number of changed pixels that triggers motion.
threshold 1500

# Noise threshold for the motion detection.
; noise_level 32

# Despeckle the image using (E/e)rode or (D/d)ilate or (l)abel.
despeckle_filter EedDl

# Number of images that must contain motion to trigger an event.
minimum_motion_frames 1

# Gap in seconds of no motion detected that triggers the end of an event.
event_gap 10

# The number of pre-captured (buffered) pictures from before motion.
pre_capture 3

# Number of frames to capture after motion is no longer detected.
post_capture 3

############################################################
# Script execution configuration parameters
############################################################

# Command to be executed when an event starts.
# ; on_event_start value

# Command to be executed when an event ends.
# ; on_event_end value

# Command to be executed when a movie file is closed.
# ; on_movie_end value

############################################################
# Picture output configuration parameters
############################################################

# File name(without extension) for pictures relative to target directory
picture_filename %Y%m%d%H%M%S-%q

############################################################
# Movie output configuration parameters
############################################################

# Create movies of motion events.
movie_output on

# Maximum length of movie in seconds.
movie_max_time 600

# The encoding quality of the movie. (0=use bitrate. 1=worst quality, 100=best)
movie_quality 80

# Container/Codec to used for the movie. See motion_guide.html
movie_codec mkv

# File name(without extension) for movies relative to target directory
movie_filename %t-%v-%Y%m%d%H%M%S

############################################################
# Webcontrol configuration parameters
############################################################

# Port number used for the webcontrol.
webcontrol_port 8080

# Restrict webcontrol connections to the localhost.
webcontrol_localhost on

# Type of configuration options to allow via the webcontrol.
webcontrol_parms 0

############################################################
# Live stream configuration parameters
############################################################

# The port number for the live stream.
stream_port 8081

# Restrict stream connections to the localhost.
stream_localhost on

##############################################################
# Camera config files - One for each camera.
##############################################################
# ; camera /etc/motion/camera1.conf
# ; camera /etc/motion/camera2.conf
# ; camera /etc/motion/camera3.conf
# ; camera /etc/motion/camera4.conf

##############################################################
# Directory to read '.conf' files for cameras.
##############################################################
; camera_dir /etc/motion/conf.d

thx!

0 replies

Mr-Dave · 2019-10-16T01:14:08Z

Mr-Dave
Oct 16, 2019
Maintainer

I found your full log over on the Arch forum so I do not need it here.

The guarantee huff table is within the code and not the configuration files. To use the v4l2 section, I would guess you'd have to get into that section of the code and make revisions. I do not know of what would be required to support the decompression of PJPG.

For the netcam_url alternative, you should revise the configuration file. The file posted above has the netcam_url line commented out via the semicolon.

0 replies

johnyradio · 2019-10-16T06:34:54Z

johnyradio
Oct 16, 2019
Author

i reverted the conf to the original:
cp /usr/share/motion/examples/motion-dist.conf /home/johny/motion.conf

Then uncommented the url line. Still getting error:

$ motion  
[0:motion] [NTC] [ALL] conf_load: Processing thread 0 - config file /home/johny/motion.conf
[0:motion] [NTC] [ALL] motion_startup: Logging to syslog
~~~~snip~~~~

As you can see in the output above, it's loading a motion.conf in my home dir (~/motion.conf) . I don't think i put that there-- did the installer?

Anyway, my intended conf (~/.motion/motion.conf) wasn't getting loaded. i deleted the accidental one in my home. Now my correct conf is loading, and i'm getting very different output:

$ motion
[0:motion] [NTC] [ALL] conf_load: Processing thread 0 - config file /home/johny/.motion/motion.conf
[0:motion] [NTC] [ALL] motion_startup: Logging to syslog
[0:motion] [NTC] [ALL] motion_startup: Motion 4.2.2 Started
[0:motion] [NTC] [ALL] motion_startup: Using default log type (ALL)
[0:motion] [NTC] [ALL] motion_startup: Using log type (ALL) log level (NTC)
[0:motion] [NTC] [STR] webu_start_strm: Starting all camera streams on port 8081
[0:motion] [NTC] [STR] webu_strm_ntc: Started camera 0 stream on port 8081
[0:motion] [NTC] [STR] webu_start_ctrl: Starting webcontrol on port 8080
[0:motion] [NTC] [STR] webu_start_ctrl: Started webcontrol on port 8080
[0:motion] [NTC] [ENC] ffmpeg_global_init: ffmpeg libavcodec version 58.35.100 libavformat version 58.20.100
[0:motion] [NTC] [ALL] translate_init: Language: English
[0:motion] [NTC] [ALL] motion_start_thread: Camera ID: 0 is from /home/johny/.motion/motion.conf
[0:motion] [NTC] [ALL] motion_start_thread: Camera ID: 0 Camera Name: (null) Service: v4l2:
[0:motion] [NTC] [ALL] main: Waiting for threads to finish, pid: 1871
[1:ml1] [NTC] [ALL] motion_init: Camera 0 started: motion detection Enabled
[1:ml1] [NTC] [VID] vid_start: Opening Netcam RTSP
Aborted (core dumped)

Here's the core dump:

# coredumpctl gdb 1871
           PID: 1871 (motion)
           UID: 1000 (johny)
           GID: 1000 (johny)
        Signal: 6 (ABRT)
     Timestamp: Tue 2019-10-15 23:48:06 PDT (7min ago)
  Command Line: motion
    Executable: /usr/bin/motion
 Control Group: /user.slice/user-1000.slice/session-1.scope
          Unit: session-1.scope
         Slice: user-1000.slice
       Session: 1
     Owner UID: 1000 (johny)
       Boot ID: 6b8306982e3242c9a8a2d1e324a7d77f
    Machine ID: e008ffcf738b49b7ae5ce83c023c0ab7
      Hostname: myegg
       Storage: /var/lib/systemd/coredump/core.motion.1000.6b8306982e3242c9a8a2d1e324a7d77f.1871.1571208486000000000000.lz4
       Message: Process 1871 (motion) of user 1000 dumped core.
                
                Stack trace of thread 1874:
                #0  0x00007f541eb1af25 raise (libc.so.6)
                #1  0x00007f541eb04897 abort (libc.so.6)
                #2  0x00007f541ecdd3dd n/a (libavdevice.so.58)
                #3  0x00007f5420477739 avformat_open_input (libavformat.so.58)
                #4  0x00005627024851ab n/a (motion)
                #5  0x0000562702487226 n/a (motion)
                #6  0x0000562702465f79 n/a (motion)
                #7  0x00005627024596f7 n/a (motion)
                #8  0x00007f541ecaf4cf start_thread (libpthread.so.0)
                #9  0x00007f541ebde2d3 __clone (libc.so.6)
                
                Stack trace of thread 1871:
                #0  0x00007f541ecb9d65 __nanosleep (libpthread.so.0)
                #1  0x000056270245530c main (motion)
                #2  0x00007f541eb06153 __libc_start_main (libc.so.6)
                #3  0x0000562702455e8e n/a (motion)
                
                Stack trace of thread 1873:
                #0  0x00007f541ebd39ef __poll (libc.so.6)
                #1  0x00007f5420807089 n/a (libmicrohttpd.so.12)
                #2  0x00007f5420807a88 n/a (libmicrohttpd.so.12)
                #3  0x00007f541ecaf4cf start_thread (libpthread.so.0)
                #4  0x00007f541ebde2d3 __clone (libc.so.6)
                
                Stack trace of thread 1872:
                #0  0x00007f541ebd39ef __poll (libc.so.6)
                #1  0x00007f5420807089 n/a (libmicrohttpd.so.12)
                #2  0x00007f5420807a88 n/a (libmicrohttpd.so.12)
                #3  0x00007f541ecaf4cf start_thread (libpthread.so.0)
                #4  0x00007f541ebde2d3 __clone (libc.so.6)

GNU gdb (GDB) 8.3.1
Copyright (C) 2019 Free Software Foundation, Inc.
....
Reading symbols from /usr/bin/motion...
(No debugging symbols found in /usr/bin/motion)
[New LWP 1874]
[New LWP 1871]
[New LWP 1873]
[New LWP 1872]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/usr/lib/libthread_db.so.1".
Core was generated by `motion'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f541eb1af25 in raise () from /usr/lib/libc.so.6
[Current thread is 1 (Thread 0x7f5415522700 (LWP 1874))]
(gdb) 
(gdb) bt
#0  0x00007f541eb1af25 in raise () from /usr/lib/libc.so.6
#1  0x00007f541eb04897 in abort () from /usr/lib/libc.so.6
#2  0x00007f541ecdd3dd in ?? () from /usr/lib/libavdevice.so.58
#3  0x00007f5420477739 in avformat_open_input () from /usr/lib/libavformat.so.58
#4  0x00005627024851ab in ?? ()
#5  0x0000562702487226 in ?? ()
#6  0x0000562702465f79 in ?? ()
#7  0x00005627024596f7 in ?? ()
#8  0x00007f541ecaf4cf in start_thread () from /usr/lib/libpthread.so.0
#9  0x00007f541ebde2d3 in clone () from /usr/lib/libc.so.6
(gdb)

Any ideas?

what's the difference between # comment and ; comment?

thx

0 replies

Mr-Dave · 2019-10-16T12:32:32Z

Mr-Dave
Oct 16, 2019
Maintainer

The netcam_url was the best option for standard processing.

I do not know what adjustments in the code are needed for resolving the Quantization table 0x00 was not defined There isn't any samples I could find regarding how to decompress PJPG's

0 replies

johnyradio · 2019-10-18T05:21:54Z

johnyradio
Oct 18, 2019
Author

My new issue may shed some light on this one.
motioneye-project/motioneye#1506

0 replies

Mr-Dave · 2019-11-28T17:05:42Z

Mr-Dave
Nov 28, 2019
Maintainer

Revised title of issue to PJPG Quantization table

Underlying issue is inability of Motion to decompress image provided in PJPG format that is provided from the camera specified.

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

PJPG Quantization table #1495

{{title}}

Replies: 7 comments

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

Select a reply

PJPG Quantization table #1495

johnyradio Oct 14, 2019

Replies: 7 comments

Mr-Dave Oct 15, 2019 Maintainer

johnyradio Oct 15, 2019 Author

Mr-Dave Oct 16, 2019 Maintainer

johnyradio Oct 16, 2019 Author

Mr-Dave Oct 16, 2019 Maintainer

johnyradio Oct 18, 2019 Author

Mr-Dave Nov 28, 2019 Maintainer

johnyradio
Oct 14, 2019

Mr-Dave
Oct 15, 2019
Maintainer

johnyradio
Oct 15, 2019
Author

Mr-Dave
Oct 16, 2019
Maintainer

johnyradio
Oct 16, 2019
Author

Mr-Dave
Oct 16, 2019
Maintainer

johnyradio
Oct 18, 2019
Author

Mr-Dave
Nov 28, 2019
Maintainer