Michael O'BrienRunning the larger Google Gemma 7B 35GB LLM for 7x Inference Performance gainTLDR; Run Gemma 7B on a single GPU with over 40 GB VRAM — preferably an 80 GB H100, 40 GB A100 or a 48G RTX-A6000 — performance will be at…Apr 22Apr 22
Michael O'BrienGoogle Gemma 7B and 2B LLM models are now available to developers as OSS on Hugging FaceOn 21st Feb 2024 Google open sourced the Gemma 7B and 2B LLM models to Hugging Face as OSS. I did some quick testing on these 2 models (10G…Feb 22Feb 22
Michael O'BrienGemini Advanced is available in Canada as of 17 Feb 2024On 8 Feb 2024 the Google Gemini Ultra 1.0 LLM based app was released worldwide as part of Google Gemini Advanced.Feb 20Feb 20
Michael O'BrienRunning the 70B LLaMA 2 LLM locally on Metal via llama.cpp on Mac Studio M2 UltraTLDR; GPU memory size is key to running large LLMs — Apple Silicon because of its unified memory allows for local simulation of…Feb 4Feb 4
Michael O'BrienTesting for Radon 222 radioactive gas levels above 100 Bq/m3 in the home as a result of the…When working remotely during Covid and splitting time between various home office locations that include a basement laboratory — watch…May 29, 2021May 29, 2021
