mastodon.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
The original server operated by the Mastodon gGmbH non-profit

Administered by:

Server stats:

330K
active users

#thinc

0 posts0 participants0 posts today

We recently added support for running spaCy transformer models on Apple Silicon Mac GPUs.

Madeesh Kannan and I have written a blog post with some background and a lot of benchmarks:

explosion.ai/blog/metal-perfor

Teasers: transformer pipelines run 4.7 times faster on the M1 Max GPU cores than on its AMX units and the MacBook Air M2 uses less power for GPU inference than CPU inference.

ExplosionFast transformer inference with Metal Performance Shaders · ExplosionWe are happy to introduce support for Metal Performance Shaders in Thinc PyTorch layers. This makes it possible to run spaCy transformer-based pipelines on GPU on Apple Silicon Macs and improves inference speed up to 4.7 times.