YPlayer: IOS video and audio player that translates and generates subtitles in real time

YPlayer is an audio-video player whose core function is to convert speech in video or audio into text subtitles in real time locally on the device. This tool can be used to help the hearing impaired watch videos without subtitles, or as a foreign language learning aid to help understand the content through real-time generated subtitles.YPlayer focuses on user privacy, and all the speech recognition process is done on the user's own device, without uploading the data to the network. It supports more than a dozen languages including Chinese, English, and Japanese, and can play a wide range of mainstream audio and video formats. The Premium feature also supports exporting the generated subtitles in a variety of formats, making it easy for users to organize and learn.

Function List

• Real-time subtitle generation. When playing audio or video, it is capable of converting voice content into text and displaying it as subtitles in real time and offline.
• Multiple language support. Supports recognition of 11 languages including Simplified Chinese, Traditional Chinese, Cantonese, English, Japanese, Korean, French, German, Italian, Russian and Thai.
• Protection of user privacy. All voice recognition and transcription functions are done locally on the device, without connecting to the network and without uploading any user data.
• Multiple Media Formats. Supported Playbackaiff, 3gp, aac, ac3, flac, mp3, mp4, m4a, m4v, wav, au, movand other audio and video files in a variety of formats.
• Subtitle Export. Paid Premium users can export the generated subtitles as aTXT, SRT, PDF, LRCand many other formats to facilitate subsequent learning and use.
• Batch processing. Supports batch transcription of files in an entire directory, or batch translation of SRT subtitle files.
• Subtitle translation. The text of subtitles already generated on the device can be translated into other languages.
• In-video text recognition (Live Text). While the video is paused, you can directly copy the text that appears on the screen.
• Video bookmark. Bookmarks can be added to key locations in the video for quick jumping around.
• Subtitle Search. Supports fuzzy search for subtitle content within a video to quickly locate the relevant screen.

Using Help

YPlayer is a tool for use in the Apple ecosystem (iPhone, iPad, Mac, Apple Vision Pro) with the main function of generating subtitles in real time while playing video or audio. Here are detailed instructions to help you get started quickly.

Installation and Compatibility

1. Get Apps: Go to the App Store and search for "YPlayer", download and install it. The app itself is free, but some premium features (such as subtitle export) need to be unlocked through in-app purchases.
2. System Requirements.
   • iPhone: Requires iOS 16.0 or later.
   • iPad: Requires iPadOS 16.0 or later.
   • Mac: Requires macOS 13.0 or later.
   • Apple Vision Pro: Requires visionOS 1.0 or later.
3. First use. The first time you use the recognition function for a specific language, the application needs to be connected to the Internet to download the corresponding language model. Once the download is complete, all subsequent recognition processes can be performed completely offline.

Core Function Operation Flow

1. Importing and playing media files

• On iPhone/iPad. When you open the YPlayer app, there is usually a "+" sign or "Import" button. You can select your audio or video files from the Files app, Albums, or other apps that support file sharing and import them into YPlayer's media library.
• On Mac. When you open YPlayer, you can select a local media file via "File" -> "Open" in the menu bar, or drag and drop the file directly into the YPlayer window to start playing.

2. Real-time generation of subtitles

1. Select Language. In the playback interface, there is usually a language selection icon or menu. Click on it to select the language of the video or audio content from a list of 11 supported languages (e.g., to watch an English video, select "English").
2. Start Playing. After selecting the correct language, start playing the media file. yPlayer automatically processes the audio and displays the recognized text subtitles in real time at the bottom of the screen.
3. Mute Recognition. Even if you mute your device's volume, YPlayer still recognizes and generates subtitles, a feature that's perfect for public places that need to be kept quiet (like libraries).

3. Exporting subtitles (advanced function)

1. Buy Premium. If you need to export subtitles, you'll need to unlock YPlayer Premium by completing an in-app purchase first.
2. Export operation.
   • When media playback is complete, find the Export or Share icon in the toolbar (usually located at the top of the window or at the bottom of the screen).
   • After clicking Export, the system will let you choose the format of the export, for exampleSRT(subtitle file),TXT(Plain text),PDFetc.
   • After choosing a format, you can save the file locally, to iCloud Drive, or share it out through other apps.
   • Caution. According to user feedback, there may be a display issue on some macOS versions, if you can't find the export button, trying to turn it off and then back on again in Settings (Tab Bar) may make it appear.

Featured Functions

In-video text recognition (Live Text)

• Pause playback when the video screen contains clear text (e.g., slides, titles).
• Like elsewhere in iOS, long press on the text in the screen with your finger or mouse and the system will recognize and highlight the text, after which you can proceed directly to the copying operation.

Subtitle Repeat and Search

• Single sentence repetition. This feature is very useful for language learners. In the subtitle area, you can usually select a particular subtitle and click the "Repeat" or loop button, and YPlayer will play the audio/video clip corresponding to that subtitle over and over again.
• Subtitle Search. Find the search box in the player interface, enter the keyword you want to find, YPlayer will list all the subtitle lines containing the word, click it to jump to the corresponding position of the video.

Batch Processing (Mac version features)

• Batch transcription. Choose "File" or related options in the menu bar, and find the "Batch Transcription" function. Select a folder containing several audio and video files, set the language and output format, YPlayer will automatically process all the files under the folder and generate corresponding subtitle files. [3.
• Batch translation. Similarly, you can use the "Batch Translate" function to select a file that holds theSRTfolder of subtitle files and specify the target translation language, the application will translate all files into subtitles in the new language.

application scenario

1. language learning
   When watching foreign movies, courses or lectures without subtitles, you can use YPlayer to generate original or translated subtitles in real time to assist listening comprehension and vocabulary learning. Learners can also export subtitled text for intensive reading and review.
2. Assisting the hearing impaired
   For hearing-impaired users, YPlayer can convert video calls and web videos from daily life into text in real time, helping them to understand conversations and audio messages and reduce communication barriers.
3. Content creation and organization
   Video creators or journalists can use YPlayer to quickly convert interview recordings and video footage into transcripts, greatly enhancing the efficiency of organizing and editing content. ExportedSRTfile can be used directly to add subtitles to a video.
4. Content consumption in a quiet environment
   In situations where external sound is not convenient, such as libraries, offices or public transportation, users can play videos through YPlayer and read the real-time generated subtitles directly to understand the content without the need to wear headphones.

QA

1. Is YPlayer completely free?
   YPlayer's basic playback and real-time subtitle generation features are free. However, some advanced features, such as exporting generated subtitles to theTXTmaybeSRTfiles, batch processing, etc., and requires an upgrade to the Premium version via an in-app purchase in order to use it.
2. Will using YPlayer transcription or translation compromise my privacy?
   No. One of the core features of YPlayer is privacy protection, all the speech recognition process is done locally on your device, utilizing Apple's CoreML and Speech framework. Your audio or video data is not uploaded to any server.
3. Why do I need an internet connection the first time I use it?
   While everyday use is completely offline, the first time a language is recognized, the application requires internet access to download an offline recognition model for that language. Once the download is complete, the network is no longer required for the recognition of that language.
4. What platforms does YPlayer support?
   YPlayer supports the Apple ecosystem, including iPhones, iPads, Mac computers, and Apple Vision Pro.
5. How accurate is the recognition?
   The accuracy depends on the clarity of the audio, the speaker's speech rate and accent. Recognition accuracy is higher when the audio source is clear. Recognition may decrease for content with high background noise or heavy accent.