> -----Original Message----- > From: Guo, Yejun <yejun....@intel.com> > Sent: 2021年4月18日 18:08 > To: ffmpeg-devel@ffmpeg.org > Cc: Guo, Yejun <yejun....@intel.com> > Subject: [PATCH 6/6] lavfi/dnn_classify: add filter dnn_classify for > classification based on detection bounding boxes > > classification is done on every detection bounding box in frame's side data, > which are the results of object detection (filter dnn_detect). > > Please refer to commit log of dnn_detect for the material for detection, > and see below for classification. > > - download material for classifcation: > wget > https://github.com/guoyejun/ffmpeg_dnn/raw/main/models/openvino/20 > 21.1/emotions-recognition-retail-0003.bin > wget > https://github.com/guoyejun/ffmpeg_dnn/raw/main/models/openvino/20 > 21.1/emotions-recognition-retail-0003.xml > wget > https://github.com/guoyejun/ffmpeg_dnn/raw/main/models/openvino/20 > 21.1/emotions-recognition-retail-0003.label > > - run command as: > ./ffmpeg -i cici.jpg -vf > dnn_detect=dnn_backend=openvino:model=face-detection-adas-0001.xml: > input=data:output=detection_out:confidence=0.6:labels=face-detection-ad > as-0001.label,dnn_classify=dnn_backend=openvino:model=emotions-recog > nition-retail-0003.xml:input=data:output=prob_emotion:confidence=0.3:la > bels=emotions-recognition-retail-0003.label:target=face,showinfo -f null - > > We'll see the detect&classify result as below: > [Parsed_showinfo_2 @ 0x55b7d25e77c0] side data - detection bounding > boxes: > [Parsed_showinfo_2 @ 0x55b7d25e77c0] source: > face-detection-adas-0001.xml, emotions-recognition-retail-0003.xml > [Parsed_showinfo_2 @ 0x55b7d25e77c0] index: 0, region: (1005, 813) -> > (1086, 905), label: face, confidence: 10000/10000. > [Parsed_showinfo_2 @ 0x55b7d25e77c0] classify: label: > happy, confidence: 6757/10000. > [Parsed_showinfo_2 @ 0x55b7d25e77c0] index: 1, region: (888, 839) -> > (967, 926), label: face, confidence: 6917/10000. > [Parsed_showinfo_2 @ 0x55b7d25e77c0] classify: label: > anger, confidence: 4320/10000. > > Signed-off-by: Guo, Yejun <yejun....@intel.com> > --- > configure | 1 + > doc/filters.texi | 36 ++++ > libavfilter/Makefile | 1 + > libavfilter/allfilters.c | 1 + > libavfilter/vf_dnn_classify.c | 330 > ++++++++++++++++++++++++++++++++++ > 5 files changed, 369 insertions(+) > create mode 100644 libavfilter/vf_dnn_classify.c > > + > +AVFilter ff_vf_dnn_classify = { > + .name = "dnn_classify", > + .description = NULL_IF_CONFIG_SMALL("Apply DNN classify filter > to the input."), > + .priv_size = sizeof(DnnClassifyContext), > + .init = dnn_classify_init, > + .uninit = dnn_classify_uninit, > + .query_formats = dnn_classify_query_formats, > + .inputs = dnn_classify_inputs, > + .outputs = dnn_classify_outputs, > + .priv_class = &dnn_classify_class, > + .activate = dnn_classify_activate, > +};
I've locally added 'const' for AVFilter ff_vf_dnn_classify, any other comment? thanks. _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-requ...@ffmpeg.org with subject "unsubscribe".
