How Much GPU Memory is Needed to Serve a Large Language Model (LLM)?

In nearly all LLM interviews, there’s one question that consistently comes up: “How much GPU memory is needed to serve a Large Language Model (LLM)?” This isn’t just a random question — it’s a key indicator of how well you understand the deployment and scalability of these powerful models in production. When working with models like … Read more

The 6 Best LLM Tools To Run Models Locally

Running large language models (LLMs) like ChatGPT and Claude usually involves sending data to servers managed by OpenAI and other AI model providers. While these services are secure, some businesses prefer to keep their data entirely offline for greater privacy. This article covers the top six tools developers can use to run and test LLMs locally, ensuring their data never leaves … Read more

5 Levels Of AI Agents (Updated)

𝗔𝘂𝘁𝗼𝗻𝗼𝗺𝗼𝘂𝘀 𝗔𝗜 𝗔𝗴𝗲𝗻𝘁𝘀 are AI systems capable of performing a series of complex tasks independently to achieve a goal. The phrases AI Agents, Autonomous Agents, Agentic Application, or what I refer to as Agentic X are all terms which are used interchangeably. Some Background I love the example from Agile’s rise in organisations, where project … Read more

Detecting Banker Malware Installed on Android Devices

This article presents mechanisms and ideas for detecting malicious applications installed on Android devices that abuse the AccessibilityService feature. It focuses on identifying these applications from the perspective of legitimate apps. Introduction This article is focused on detection mechanisms of potentially malicious Android applications, which I implemented and shared on my GitHub about 3 years … Read more

Does the Sun Host a Black Hole at Its Center?

In 1971, Stephen Hawking suggested that a mini black hole from the early universe could be lurking at the center of the sun. His proposal was extended in 1975 by Don Clayton and collaborators who suggested that the power generated by the infall of matter onto such a black hole could explain the observed deficit in neutrinos of the … Read more

Top 10 AI Business Ideas For 2025

Unlocking Future Opportunities: The Top 10 AI Business Ideas for 2025 Asartificial intelligence continues to evolve, its potential to reshape industries and create new business opportunities is growing exponentially. By 2025, AI is expected to drive unprecedented innovation across sectors like healthcare, finance, retail, and more. From advanced automation solutions that streamline operations to personalized … Read more