Octav

Octav fine-tuned their local LLM infrastructure using **Llama Throughput Lab** to maximize performance on Apple M3 Ultra hardware. **Key optimizations:** - Batch and micro-batch sizes - Slot management - Parallelism configuration - Context window efficiency The setup runs **LlamaCPP locally** with GLM-4.7-Flash Q4_K_M model, using 2 instances with 2 parallel slots each, fronted by Nginx load balancer. **Why local deployment?** - Removes cloud provider dependency - Enables reliable 24/7 task execution - Provides full control over context and throughput The optimizations achieved maximum speed without crashing Metal, demonstrating practical approaches to self-hosted AI infrastructure. Tool: [Llama Throughput Lab](https://github.com/alexziskind1/llama-throughput-lab)

**Octav is running LlamaCPP locally on Apple M3 Ultra** hardware using the GLM-4.7-Flash Q4_K_M model to eliminate cloud provider dependencies. **Technical setup:** - 2 instances running simultaneously - Each instance handles 2 parallel slots for controlled concurrency - Nginx load balancer distributes requests across instances - Metal acceleration utilized for performance optimization **Key benefits:** - Removes reliance on external cloud providers - Enables reliable 24/7 task execution - Provides full control over context and throughput - Maintains low latency through efficient load balancing - Prevents memory limit issues through predictable concurrency management The local deployment strategy prioritizes infrastructure independence and operational reliability over cloud-based alternatives.

**Octav has introduced Virtual Balance**, a new feature that allows users to manually track cryptocurrency holdings that exist outside blockchain networks. **Key capabilities:** - Add manual balances for custodial accounts and OTC deals - Track off-chain holdings alongside on-chain wallets - View complete net worth in one unified dashboard The feature addresses a gap in portfolio management, as not all crypto assets are stored on public blockchains. Users can now bundle their exchange balances, custodial accounts, and traditional wallet addresses for comprehensive tracking. **Available now** at [pro.octav.fi](http://pro.octav.fi)

Octav has partnered with Webacy to integrate a Risk Scores widget directly into the Octav dashboard, enabling users to monitor wallet security in real-time. **Key Features:** - Check if wallets have interacted with risky smart contracts - Identify rug pull exposure - Detect scam connections The widget is now live at [pro.octav.fi/widget-explorer/walletRiskScore](https://pro.octav.fi/widget-explorer/walletRiskScore). Additional details about the integration are available at [Webacy's announcement](https://world.webacy.com/dd-in-the-wild-octavs-integrated-risk-intelligence/). This integration provides Octav users with enhanced security monitoring capabilities, allowing them to assess potential risks associated with their wallet activities directly from their dashboard.

Octav has integrated with Otomato to enable users to set up alerts for their DeFi positions directly within the app. Users can now receive email notifications about their portfolio activity, providing real-time insights and increased transparency for their DeFi holdings. **Key features:** - In-app alert configuration for DeFi positions - Email notification system - Real-time portfolio monitoring This partnership follows Octav's recent collaboration with Blockscout, which made Blockscout the default blockchain explorer in the Octav app.

**Dune and Octav integration eliminates tab switching** Traders can now embed Dune Analytics charts directly into their Octav trading boards, streamlining workflow management. **Key features:** - Direct dashboard integration between platforms - Import any Dune chart into Octav workspace - Unified interface for data analysis and trading This integration addresses a common pain point for crypto traders who previously needed multiple browser tabs to access both analytics and trading tools.

Gearbox Protocol has launched a dedicated instance for Lido, reaching $25M in TVL shortly after launch. The integration creates a new wstETH credit market powered by Mellow Protocol vaults. Key features: - Up to 20x leverage for borrowers using Mellow markets - Lenders can provide wstETH without impermanent loss or lockups - Annual rewards available on DVstETH (14x) and rstETH (20x) The partnership showcases Gearbox's institutional-grade features: - Customizable rates - Deep liquidity - Security-tested infrastructure - No liquidity fragmentation [Learn more about the Lido instance](https://blog.gearbox.fi/lido-instance-2/)

Overnight Finance has launched a new feature enabling users to edit multiple transactions simultaneously, marking a significant improvement in transaction management efficiency. - Users can now select multiple transactions at once - Single-click transformation of transaction attributes - Supports bulk changes to transaction types and protocols - Streamlines reconciliation process This update builds on previous improvements to their transaction handling system, including the Zapin feature that allows consolidating multiple transactions into one.

Berachain, a new EVM-compatible L1 blockchain, introduces Proof-of-Liquidity (PoL) - a novel consensus mechanism that combines network security with liquidity provision. The system uses two tokens: - $BERA: Native gas token for security - $BGT: Governance token for liquidity providers Key features: - Validators can stake multiple tokens as liquidity - Integrated BeraHub for swapping, bridging, and LPing - $150k BERA rewards available through Euler markets The ecosystem incentivizes participation through an Incentive Marketplace where protocols can reward users with native tokens for interactions. [BeraHub](https://hub.berachain.com/) provides a streamlined user experience for financial operations.

Twitter/X has announced significant platform changes affecting user experience and content distribution: - New algorithm adjustments prioritize verified accounts and premium subscribers - Content visibility now heavily weighted toward paid users - Free accounts seeing reduced reach and engagement metrics These changes mark a continued shift toward a paid-subscription model, building on previous updates from March 2024. Early data suggests a 40% decrease in organic reach for non-verified accounts. Platform officials state this aligns with efforts to reduce spam and enhance content quality. Critics argue it creates a two-tiered user system. *Implementation begins April 1, 2025*