Commit Graph

24 Commits

Author SHA1 Message Date
Georgi Gerganov
72d967bce4 Use Accelerate framework on Apple silicon
Huge performance improvement in the Encode (almost x2 on MacBook M1 Pro)

Also various extra optimizations:

- Multi-threaded NORM operator
- Faster GELU via F16 cast
2022-10-18 00:12:51 +03:00
Georgi Gerganov
36945162fa Update README.md (ref #50) 2022-10-15 09:40:08 +03:00
Georgi Gerganov
b2f1600aa3 Update README.md 2022-10-12 21:25:42 +03:00
Topping1
1348796a93 Update README.md (#43)
* Update README.md

Updated README.md to list new features, such as subtitle file support (VTT and SRT)

* Update README.md

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2022-10-12 07:32:14 +03:00
Georgi Gerganov
8d94358251 Update README.md 2022-10-11 00:36:32 +03:00
Georgi Gerganov
ad6693fb64 Update README.md 2022-10-10 22:16:25 +03:00
Georgi Gerganov
63b6786767 Minor 2022-10-10 22:06:27 +03:00
Georgi Gerganov
f7ab81fe51 Update README.md 2022-10-10 22:05:37 +03:00
Georgi Gerganov
4c4ab71d4d Update README.md 2022-10-08 11:46:34 +03:00
Georgi Gerganov
2d47693435 Update README.md 2022-10-08 11:43:42 +03:00
Georgi Gerganov
700898e6ed ref #22 : add option to provide multiple input .wav files 2022-10-05 23:44:10 +03:00
Georgi Gerganov
6b1c3cc198 Update README.md 2022-10-05 23:13:15 +03:00
Georgi Gerganov
b8f713482e Minor updates 2022-10-05 23:11:02 +03:00
Georgi Gerganov
e7a15876f8 Update README.md 2022-10-04 23:27:25 +03:00
Georgi Gerganov
d71e567656 Update README.md 2022-10-02 18:19:22 +03:00
Georgi Gerganov
62897e8ae6 Update README.md 2022-10-01 00:01:04 +03:00
Georgi Gerganov
3bcdbdfc32 Reduce memory usage even more + better sampling
- The encode/decode memory buffers are now reused
- If the 30-sec segment goes for too long without a timestamp token, we
  force one. Improves transcription for large model
- Stereo support
- Add "micro-machines.wav" sample
2022-09-30 19:35:27 +03:00
Georgi Gerganov
310f4883d1 Update README.md 2022-09-29 23:48:01 +03:00
Georgi Gerganov
fd3f3d748f Update README.md 2022-09-29 23:37:59 +03:00
Georgi Gerganov
5877c3578e ref #4 : added transcription timestamps
Can be turned off with "-nt" argument.
Performance has also improved.
2022-09-29 23:09:39 +03:00
Georgi Gerganov
4352a6018b Update README.md 2022-09-28 21:13:32 +03:00
Georgi Gerganov
f888c2373d Flash + language support (ref #2)
- Achieved big performance improvement + memory usage reduction
- Can now translate / transcribe different languages
2022-09-28 21:07:32 +03:00
Georgi Gerganov
476182e439 Update README.md and simplify usage 2022-09-26 09:36:51 +03:00
Georgi Gerganov
f2456f8d93 Create README.md 2022-09-25 22:59:04 +03:00