Analyze procedure

Official Content
This documentation is valid for:

Gets the analysis result of a video after it has been processed by Process procedure.

Parameters

Configuration

The following table resumes the configuration properties that you must set before calling this AI task.

Property Google Cloud AI IBM Watson Microsoft Azure SAP Leonardo
Key From Video Intelligence API - From Video Indexer -
Account   - From Azure Connect -

Sample

The available features by each provider are listed in the following table. In case there is no result for some feature, its field will be empty.

Feature Google Cloud AI IBM Watson Microsoft Azure SAP Leonardo
Speeches    
Categories    
Faces      
OCRs      
Sentiments      


Taking the following video input, the table below shows the analysis made for each provider and the time elapsed between it was sent to be processed until it has been ready for being analyzed.

Provider Output Benchmark
Google Cloud AI
{
    "Completed": true, 
    "Progress": 100,
    "Id": "{google_video_id}",
    "Speeches": [{
            "label": "Just like a true artist a masterpiece of 
                      Vols as it happens in real time.",
            "confidence": 0.8241047,
            "Info": [{
                    "property": "START",
                    "value": "0s"
                }, {
                    "property": "END",
                    "value": "4.200s"
                }
            ]
        }, {
            "label": " Genexus with live editing dream like a kid 
                       work like an artist create like a pro.",
            "confidence": 0.8710277,
            "Info": [{
                    "property": "START",
                    "value": "7.700s"
                }, {
                    "property": "END",
                    "value": "14.700s"
                }
            ]
        }
    ],
    "Categories": [{
            "label": "mobile phone",
            "confidence": 0.4763316,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.000"
                }, {
                    "property": "END-1",
                    "value": "00:00:02.021"
                }
            ]
        }, {
            "label": "mobile device",
            "confidence": 0.67164063,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.000"
                }, {
                    "property": "END-1",
                    "value": "00:00:02.021"
                }
            ]
        }, {
            "label": "smartphone",
            "confidence": 0.36822546,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.000"
                }, {
                    "property": "END-1",
                    "value": "00:00:02.021"
                }
            ]
        }, {
            "label": "feature phone",
            "confidence": 0.7129101571428571428571428571,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-7",
                    "value": "00:00:05.080"
                }
            ]
        }, {
            "label": "black",
            "confidence": 0.95241495,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:11.048"
                }, {
                    "property": "START-2",
                    "value": "00:00:12.020"
                }, {
                ...
                }, {
                    "property": "START-10",
                    "value": "00:00:21.009"
                }
            ]
        }, {
            "label": "product",
            "confidence": 0.7823901175,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:07.096"
                }, {
                    "property": "START-2",
                    "value": "00:00:17.069"
                }, {
                ...
                }, {
                    "property": "START-4",
                    "value": "00:00:21.009"
                }
            ]
        }, {
            "label": "gadget",
            "confidence": 0.92548106375,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-8",
                    "value": "00:00:07.096"
                }
            ]
        }, {
            "label": "electronics",
            "confidence": 0.7306240733333333333333333333,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-9",
                    "value": "00:00:09.014"
                }
            ]
        }, {
            "label": "brand",
            "confidence": 0.5673828673684210526315789474,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:01.058"
                }, {
                    "property": "START-2",
                    "value": "00:00:02.060"
                }, {
                ...
                }, {
                    "property": "START-19",
                    "value": "00:00:21.009"
                }
            ]
        }, {
            "label": "communication device",
            "confidence": 0.7557767875,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-8",
                    "value": "00:00:07.096"
                }
            ]
        }, {
            "label": "sky",
            "confidence": 0.728198775,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:11.048"
                }, {
                    "property": "START-2",
                    "value": "00:00:12.020"
                }, {
                ...
                }, {
                    "property": "START-10",
                    "value": "00:00:21.009"
                }
            ]
        }, {
            "label": "flooring",
            "confidence": 0.41395074,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:02.060"
                }, {
                    "property": "START-2",
                    "value": "00:00:03.063"
                }
            ]
        }, {
            "label": "shelf",
            "confidence": 0.4387352,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:02.060"
                }
            ]
        }, {
            "label": "electronic device",
            "confidence": 0.8647810466666666666666666667,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-9",
                    "value": "00:00:09.014"
                }
            ]
        }, {
            "label": "product design",
            "confidence": 0.6257422770588235294117647059,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-17",
                    "value": "00:00:21.009"
                }
            ]
        }, {
            "label": "portable communications device",
            "confidence": 0.6782316714285714285714285714,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-7",
                    "value": "00:00:05.080"
                }
            ]
        }, {
            "label": "shelving",
            "confidence": 0.412489015,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:02.060"
                }, {
                    "property": "START-2",
                    "value": "00:00:04.069"
                }
            ]
        }, {
            "label": "computer hardware",
            "confidence": 0.44277436,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:01.058"
                }
            ]
        }, {
            "label": "electronic instrument",
            "confidence": 0.49085233,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:01.058"
                }
            ]
        }, {
            "label": "multimedia",
            "confidence": 0.4773627869230769230769230769,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-13",
                    "value": "00:00:14.083"
                }
            ]
        }, {
            "label": "computer monitor",
            "confidence": 0.50538915,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:07.096"
                }
            ]
        }, {
            "label": "phenomenon",
            "confidence": 0.7547649,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:11.048"
                }, {
                    "property": "START-2",
                    "value": "00:00:12.020"
                }, {
                ...
                }, {
                    "property": "START-10",
                    "value": "00:00:21.009"
                }
            ]
        }, {
            "label": "darkness",
            "confidence": 0.702858785,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:11.048"
                }, {
                    "property": "START-2",
                    "value": "00:00:12.020"
                }, {
                ...
                }, {
                    "property": "START-10",
                    "value": "00:00:21.009"
                }
            ]
        }, {
            "label": "mobile phone",
            "confidence": 0.8544927925,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-8",
                    "value": "00:00:07.096"
                }
            ]
        }, {
            "label": "display device",
            "confidence": 0.66004828,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:01.058"
                }, {
                    "property": "START-2",
                    "value": "00:00:07.096"
                }
            ]
        }, {
            "label": "graphics",
            "confidence": 0.57838248,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:11.048"
                }, {
                    "property": "START-2",
                    "value": "00:00:12.020"
                }, {
                ...
                }, {
                    "property": "START-10",
                    "value": "00:00:21.009"
                }
            ]
        }, {
            "label": "midnight",
            "confidence": 0.490563215,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:11.048"
                }, {
                    "property": "START-2",
                    "value": "00:00:12.020"
                }, {
                ...
                }, {
                    "property": "START-10",
                    "value": "00:00:21.009"
                }
            ]
        }, {
            "label": "document",
            "confidence": 0.5087058,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:09.014"
                }
            ]
        }, {
            "label": "angle",
            "confidence": 0.55732546,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:05.080"
                }, {
                    "property": "START-2",
                    "value": "00:00:06.087"
                }, {
                ...
                }, {
                    "property": "START-5",
                    "value": "00:00:10.030"
                }
            ]
        }, {
            "label": "screenshot",
            "confidence": 0.451265465,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:11.048"
                }, {
                    "property": "START-2",
                    "value": "00:00:12.020"
                }, {
                ...
                }, {
                    "property": "START-10",
                    "value": "00:00:21.009"
                }
            ]
        }, {
            "label": "text",
            "confidence": 0.863238075,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:06.087"
                }, {
                    "property": "START-2",
                    "value": "00:00:07.096"
                }, {
                ...
                }, {
                    "property": "START-14",
                    "value": "00:00:21.009"
                }
            ]
        }, {
            "label": "atmosphere of earth",
            "confidence": 0.79306614,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:12.064"
                }
            ]
        }, {
            "label": "graphic design",
            "confidence": 0.48747425,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:17.069"
                }, {
                    "property": "START-2",
                    "value": "00:00:19.099"
                }
            ]
        }, {
            "label": "telephone",
            "confidence": 0.5075905257142857142857142857,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-7",
                    "value": "00:00:05.080"
                }
            ]
        }, {
            "label": "telephony",
            "confidence": 0.5244649657142857142857142857,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-7",
                    "value": "00:00:05.080"
                }
            ]
        }, {
            "label": "media",
            "confidence": 0.407669325,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:03.063"
                }, {
                    "property": "START-2",
                    "value": "00:00:07.096"
                }
            ]
        }, {
            "label": "paper product",
            "confidence": 0.40085325,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:06.087"
                }, {
                ...
                }, {
                    "property": "START-4",
                    "value": "00:00:10.030"
                }
            ]
        }, {
            "label": "computer accessory",
            "confidence": 0.41228032,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:07.096"
                }
            ]
        }, {
            "label": "technology",
            "confidence": 0.8440843188888888888888888889,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-9",
                    "value": "00:00:09.014"
                }
            ]
        }, {
            "label": "white",
            "confidence": 0.9594464,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:12.064"
                }
            ]
        }, {
            "label": "paper",
            "confidence": 0.59338312,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:05.080"
                }, {
                    "property": "START-2",
                    "value": "00:00:06.087"
                }, {
                ...
                }, {
                    "property": "START-5",
                    "value": "00:00:10.030"
                }
            ]
        }, {
            "label": "design",
            "confidence": 0.704395194,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:05.080"
                }, {
                    "property": "START-2",
                    "value": "00:00:06.087"
                }, {
                ...
                }, {
                    "property": "START-5",
                    "value": "00:00:10.030"
                }
            ]
        }, {
            "label": "cellular network",
            "confidence": 0.69048995,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-7",
                    "value": "00:00:05.080"
                }
            ]
        }, {
            "label": "computer wallpaper",
            "confidence": 0.6304926405882352941176470588,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-17",
                    "value": "00:00:21.009"
                }
            ]
        }, {
            "label": "logo",
            "confidence": 0.715734012,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:11.048"
                }, {
                    "property": "START-2",
                    "value": "00:00:12.020"
                }, {
                ...
                }, {
                    "property": "START-10",
                    "value": "00:00:21.009"
                }
            ]
        }, {
            "label": "trademark",
            "confidence": 0.415102925,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:19.099"
                }, {
                    "property": "START-2",
                    "value": "00:00:21.009"
                }
            ]
        }, {
            "label": "atmosphere",
            "confidence": 0.76842415,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:11.048"
                }, {
                    "property": "START-2",
                    "value": "00:00:12.020"
                }, {
                ...
                }, {
                    "property": "START-5",
                    "value": "00:00:14.083"
                }
            ]
        }, {
            "label": "triangle",
            "confidence": 0.7155078,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:05.080"
                }
            ]
        }, {
            "label": "light",
            "confidence": 0.8200014,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:11.048"
                }
            ]
        }, {
            "label": "material property",
            "confidence": 0.44692206,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-8",
                    "value": "00:00:06.087"
                }
            ]
        }, {
            "label": "smartphone",
            "confidence": 0.6743124275,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-8",
                    "value": "00:00:07.096"
                }
            ]
        }, {
            "label": "product",
            "confidence": 0.528562268125,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:00.020"
                }, {
                    "property": "START-2",
                    "value": "00:00:00.022"
                }, {
                ...
                }, {
                    "property": "START-16",
                    "value": "00:00:21.009"
                }
            ]
        }, {
            "label": "font",
            "confidence": 0.6727489471428571428571428571,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:06.087"
                }, {
                    "property": "START-2",
                    "value": "00:00:07.096"
                }, {
                ...
                }, {
                    "property": "START-14",
                    "value": "00:00:21.009"
                }
            ]
        }, {
            "label": "space",
            "confidence": 0.434149805,
            "Info": [{
                    "property": "START-1",
                    "value": "00:00:11.048"
                }, {
                    "property": "START-2",
                    "value": "00:00:12.020"
                }, {
                ...
                }, {
                    "property": "START-10",
                    "value": "00:00:21.009"
                }
            ]
        }
    ]
}
12165ms
IBM Watson - -
Microsoft Azure
{
    "Completed": true,
    "Progress": 100,
    "Id": "{microsoft_video_id}",
    "Speeches": [{
            "label": "Just like a true artist a masterpiece evolved as 
                      it happens in real time, Genexus with live 
                      editing dream like a kid.",
            "confidence": 0.7632,
            "Info": [{
                    "property": "START-1",
                    "value": "0:00:00"
                }, {
                    "property": "END-1",
                    "value": "0:00:11.41"
                }, {
                    "property": "SPEAKER",
                    "value": "#1"
                }
            ]
        }, {
            "label": "Work like an artist create like a pro.",
            "confidence": 0.7116,
            "Info": [{
                    "property": "START-1",
                    "value": "0:00:11.42"
                }, {
                    "property": "END-1",
                    "value": "0:00:19.47"
                }, {
                    "property": "SPEAKER",
                    "value": "#1"
                }
            ]
        }
    ],
    "Categories": [{
            "label": "indoor",
            "confidence": 0.9575,
            "Info": [{
                    "property": "START-1",
                    "value": "0:00:00"
                }, {
                    "property": "END-1",
                    "value": "0:00:10.24"
                }
            ]
        }, {
            "label": "sign",
            "confidence": 0.8783,
            "Info": [{
                    "property": "START-1",
                    "value": "0:00:17.92"
                }, {
                    "property": "END-1",
                    "value": "0:00:19.2"
                }
            ]
        }
    ],
    "Sentiments": [{
            "score": 0.7003,
            "Info": [{
                    "property": "START-1",
                    "value": "0:00:03.81"
                }, {
                    "property": "END-1",
                    "value": "0:00:05.91"
                }, {
                ...
                }, {
                    "property": "END-3",
                    "value": "0:00:19.05"
                }
            ]
        }, {
            "score": 0.9232,
            "Info": [{
                    "property": "START-1",
                    "value": "0:00:00"
                }, {
                    "property": "END-1",
                    "value": "0:00:03.73"
                }, {
                ...
                }, {
                    "property": "END-2",
                    "value": "0:00:12.15"
                }
            ]
        }
    ],
    "OCRs": [{
            "label": "Dream like a kid",
            "confidence": 0.9545,
            "top": 0,
            "left": 0,
            "width": 0,
            "height": 0,
            "Info": [{
                    "property": "START-1",
                    "value": "0:00:10.08"
                }, {
                    "property": "END-1",
                    "value": "0:00:11.52"
                }
            ]
        }, {
            "label": "Work like an artist",
            "confidence": 0.9578,
            "top": 0,
            "left": 0,
            "width": 0,
            "height": 0,
            "Info": [{
                    "property": "START-1",
                    "value": "0:00:11.52"
                }, {
                    "property": "END-1",
                    "value": "0:00:13.44"
                }
            ]
        }, {
            "label": "Create like a pro",
            "confidence": 0.9871,
            "top": 0,
            "left": 0,
            "width": 0,
            "height": 0,
            "Info": [{
                    "property": "START-1",
                    "value": "0:00:13.44"
                }, {
                    "property": "END-1",
                    "value": "0:00:17.76"
                }
            ]
        }, {
            "label": "GeneD(us",
            "confidence": 0.436,
            "top": 0,
            "left": 0,
            "width": 0,
            "height": 0,
            "Info": [{
                    "property": "START-1",
                    "value": "0:00:18.72"
                }, {
                    "property": "END-1",
                    "value": "0:00:19.2"
                }
            ]
        }, {
            "label": "Simplify Software Development",
            "confidence": 0.9214,
            "top": 0,
            "left": 0,
            "width": 0,
            "height": 0,
            "Info": [{
                    "property": "START-1",
                    "value": "0:00:19.2"
                }, {
                    "property": "END-1",
                    "value": "0:00:22.08"
                }
            ]
        }, {
            "label": "Start creating now",
            "confidence": 0.991,
            "top": 0,
            "left": 0,
            "width": 0,
            "height": 0,
            "Info": [{
                    "property": "START-1",
                    "value": "0:00:22.08"
                }, {
                    "property": "END-1",
                    "value": "0:00:22.2"
                }
            ]
        }, {
            "label": "genexus.com/genexusl 5",
            "confidence": 0.7955,
            "top": 0,
            "left": 0,
            "width": 0,
            "height": 0,
            "Info": [{
                    "property": "START-1",
                    "value": "0:00:22.08"
                }, {
                    "property": "END-1",
                    "value": "0:00:22.2"
                }
            ]
        }
    ]
}
11860ms
SAP Leonardo - -

Notes

  • When you use MS Cognitive Services, in the 'Faces' field of OutputAnalysis, returns a key 'thumbnail' in the Info collection with the cropped image of the identified face (no region top/left/width/height is available).
  • To get the Key/Account for use MS Cognitive Services, please refer to Note section of this document.

Scope

Platforms Web(.NET,.NETCore,Java), SmartDevices(Android,iOS)
Connectivity Online

Availability

This procedure is available as of GeneXus 16 upgrade 1.

See also

Was this page helpful?
What Is This?
Your feedback about this content is important. Let us know what you think.