Clips AI

Clips AI is an open-source Python library that automatically converts longform video into clips. With just a few lines of code, you can segment a video into multiple clips and resize its aspect ratio from 16:9 to 9:16.

Clips AI is designed for audio-centric, narrative-based videos such as podcasts, interviews, speeches, and sermons. Our clipping algorithm analyzes a video's transcript to identify and create clips. Our resizing algorithm dynamically reframes videos to focuse on the current speaker, converting the video into various aspect ratios.

Installation: Install Python dependencies. We highly suggest using a virtual environment (such as venv) to avoid dependency conflicts. pip install clipsai. Copy pip install whisperx@git+https://github.com/m-bain/whisperx.git. Copy Install libmagic. Install ffmpeg.

Read resizing reference: A hugging face access token is required to resize a video since Pyannote is utilized for speaker diarization. You won't be charged for using Pyannote and instructions are on the Pyannote HuggingFace page. For resizing the original video to the desired aspect ratio, refer to the resizing reference. from clipsai import resize; crops = resize(video_file_path="/abs/path/to/video.mp4", pyannote_auth_token="pyannote_token", aspect_ratio=(9, 16)); print("Crops: ", crops.segments)

Use cases

• Designed for audio-centric, narrative-based videos such as podcasts, interviews, speeches, and sermons.