Use Open AXES
Open AXES is an output of the AXES European project. It gathers innovative audiovisual content analyses technologies including an ergonomic interface to navigate video archives.
Open AXES is available on OW2 (the open source community for infrastructure software) and is based on the existing OW2 WebLab integration platform for multimedia processing. View this manual for using & searching Open AXES on a local computer. The installation process requires IT administration skills.
Get a first impression of the system by this Live Preview (login/pwd: axes/axes).
The version 1.1.0 contains:
Info: The main difference with previous version is that it now able to handle French speaking videos in addition to English speaking videos.
- a folder gathering service, provided by Airbus Defence and Space, enabling to collect video files and metadata (in various format: json, properties, rdf) in a set of relevant folders
- a shot-detector and keyframe-extraction service provided by Technicolor and enabling to select some keyframes representative of each shot of the video (and prevent image based components to analyse every single frame of a video or picking random ones) which is available from binaries and only allowed for non commercial use
- a video-normaliser service, provided by Airbus Defence and Space and based on FFmpeg, enabling to convert the original video in appropriate formats for other components and UI
- an image-classifier service, provided by the Katholieke Universiteit Leuven in charge of classifying selected images over a set of more than 1000 classes which is available from binaries and allowed for non commercial use only
- an automated speech recognition service, provided by Airbus Defence and Space and based on CMU Sphinx, extracting the text from English or French (using LIUM models) audio speech
- a named entity detection service, provided by Airbus Defence and Space and based on GATE platform, extracting organisation, persons and locations from the text of the speeches
- a text and metadata indexing service as well as the search and fuse search interfaces, named LIMAS and provided by the University of Twente, saving the results of the processes and being the backend server for the UI, also in charge of calling the other search engines and fusing their result. It is provided with an Apache 2 licence. The codebase is available at: https://bitbucket.org/alyr/limas/
- a near-duplicate image search service, provided by Airbus Defence and Space and based on the open source project Pastec
- an on-the-fly visual analysis service, provided by the University of Oxford and enabling to search inside a database of images using words, without having a predefined set of classifiers. It learns upon request a model by gathering positive examples from well-known Web search engines and looks up for similar images inside its own database. The codebase is available at https://github.com/kencoken/cpuvisor-srv with an Apache 2 licence
- a thin client web interface provided by the Dublin City University enables to search inside text and metadata to get the indexed video, to search for near duplicate images either from indexed video keyframes or for any user uploaded image and to search for images matching a visual concept (either using a pre-trained or by learning on the fly the concept). It enables various operations over the videos like virtual cutting, collection management and social sharing (like/dislike). The codebase is available at https://github.com/kevinmcguinness/axes-research using an Apache 2 licence
All components are packaged into an OW2 WebLab application. The installation can be done on Linux 64bits Ubuntu/Debian distribution. It has been validated on Ubuntu 14.04, Ubuntu 14.10 and Mint 17. If you are running another operating system (Windows or Mac) and want to try Open AXES, you can install Open AXES on a Ubuntu 64 bits Virtual Machine. Tutorials are available on the web to install a virtual machine on Mac and on Windows.
The goal of AXES is to develop tools that provide various types of users with new engaging ways to interact with audiovisual libraries, helping them to discover, browse, search and enrich video archives.