Restructure repository: organize tools by purpose, create what search tool

- Move single-file tools to tools/ organized by category (security, forensics, data, etc.)
- Move multi-file projects to projects/ (go-tools, puzzlebox, timesketch, rust-tools)
- Move system scripts to scripts/ (proxy, display, setup, windows)
- Organize config files in config/ (shell, visidata, applications)
- Move experimental tools to archive/experimental
- Create 'what' fuzzy search tool with progressive enhancement (ollama->fzf->grep)
- Add initial metadata database for intelligent tool discovery
- Preserve git history using 'git mv' commands

.what_db.json

@@ -0,0 +1,149 @@
+{
+  "version": "1.0",
+  "tools": {
+    "tools/security/scan_vt.py": {
+      "path": "tools/security/scan_vt.py",
+      "name": "scan_vt.py",
+      "type": "python script",
+      "summary": "Scans files against VirusTotal using MD5 hashes and displays detection results with positives/total ratios and permalink.",
+      "purpose": "Malware detection and threat analysis",
+      "short_description": "VirusTotal file scanner with detection ratios",
+      "executable": true
+    },
+    "tools/security/imphash.py": {
+      "path": "tools/security/imphash.py", 
+      "name": "imphash.py",
+      "type": "python script",
+      "summary": "Calculates and displays the import hash (imphash) of PE files using pefile library for malware analysis.",
+      "purpose": "Malware analysis and PE file fingerprinting",
+      "short_description": "PE import hash calculator",
+      "executable": true
+    },
+    "tools/security/scapy_arp.py": {
+      "path": "tools/security/scapy_arp.py",
+      "name": "scapy_arp.py", 
+      "type": "python script",
+      "summary": "Multi-threaded ARP network scanner using Scapy to discover live hosts on a /24 network range with MAC addresses.",
+      "purpose": "Network discovery and reconnaissance",
+      "short_description": "threaded ARP network scanner",
+      "executable": true
+    },
+    "tools/data/domgrep.py": {
+      "path": "tools/data/domgrep.py",
+      "name": "domgrep.py",
+      "type": "python script", 
+      "summary": "Extracts domain names from URLs read from stdin, filtering out IP addresses and handling malformed URLs gracefully.",
+      "purpose": "Data extraction and URL processing",
+      "short_description": "extract domains from URL lists",
+      "executable": true
+    },
+    "tools/data/unum.py": {
+      "path": "tools/data/unum.py",
+      "name": "unum.py",
+      "type": "python script",
+      "summary": "Analyzes Unicode characters showing decimal/hex codes, categories, and official Unicode names with proper formatting.",
+      "purpose": "Text analysis and Unicode debugging",
+      "short_description": "detailed Unicode character analyzer",
+      "executable": true
+    },
+    "tools/forensics/chechsqlite.py": {
+      "path": "tools/forensics/chechsqlite.py",
+      "name": "chechsqlite.py",
+      "type": "python script",
+      "summary": "Scans SQLite databases for tables containing password or hash-related columns for security analysis.",
+      "purpose": "Database security analysis",
+      "short_description": "find password/hash columns in SQLite DBs",
+      "executable": true
+    },
+    "tools/hashing/scatterhash.py": {
+      "path": "tools/hashing/scatterhash.py",
+      "name": "scatterhash.py", 
+      "type": "python script",
+      "summary": "Performs sparse hashing of large files by sampling blocks across the file for efficient integrity checking and validation.",
+      "purpose": "Large file integrity verification",
+      "short_description": "sparse hashing for huge files",
+      "executable": true
+    },
+    "tools/hashing/libarchivesum.py": {
+      "path": "tools/hashing/libarchivesum.py",
+      "name": "libarchivesum.py",
+      "type": "python script",
+      "summary": "Calculates hashes of individual files within archives (zip, tar, etc.) without extracting them.",
+      "purpose": "Archive analysis and integrity checking",
+      "short_description": "like md5sum but for files inside archives",
+      "executable": true
+    },
+    "tools/system/ltop.py": {
+      "path": "tools/system/ltop.py",
+      "name": "ltop.py", 
+      "type": "python script",
+      "summary": "Real-time frequency counter for stdin lines, showing top N most common entries with live updates using curses.",
+      "purpose": "Log analysis and monitoring",
+      "short_description": "like top but for line frequency in streams",
+      "executable": true
+    },
+    "tools/network/ipgrep": {
+      "path": "tools/network/ipgrep",
+      "name": "ipgrep",
+      "type": "shell script",
+      "summary": "Comprehensive IP and MAC address extractor with sorting, deduplication, ping testing, and DNS resolution capabilities.",
+      "purpose": "Network analysis and IP processing", 
+      "short_description": "advanced IP/MAC extractor with ping testing",
+      "executable": true
+    },
+    "tools/security/certwipe": {
+      "path": "tools/security/certwipe",
+      "name": "certwipe",
+      "type": "shell script",
+      "summary": "Professional disk wiping tool supporting ATA SecureErase with frozen disk handling and fallback to dc3dd overwriting.",
+      "purpose": "Data destruction and security",
+      "short_description": "professional disk wiper with SecureErase",
+      "executable": true
+    },
+    "tools/system/watchgrowth.sh": {
+      "path": "tools/system/watchgrowth.sh", 
+      "name": "watchgrowth.sh",
+      "type": "shell script",
+      "summary": "Monitors file/directory size growth in real-time, showing transfer speeds and optional progress percentage.",
+      "purpose": "File monitoring and transfer analysis",
+      "short_description": "real-time file growth monitor",
+      "executable": true
+    },
+    "projects/timesketch/deploy_timesketch.sh": {
+      "path": "projects/timesketch/deploy_timesketch.sh",
+      "name": "deploy_timesketch.sh",
+      "type": "shell script", 
+      "summary": "Automated deployment script for Timesketch digital forensics timeline analysis platform with Docker Compose setup.",
+      "purpose": "Digital forensics infrastructure deployment",
+      "short_description": "deploy Timesketch forensic timeline platform",
+      "executable": true
+    },
+    "tools/system/backup_docker.sh": {
+      "path": "tools/system/backup_docker.sh",
+      "name": "backup_docker.sh", 
+      "type": "shell script",
+      "summary": "Comprehensive Docker Compose stack backup including images, configs, and volumes with incremental storage optimization.",
+      "purpose": "Container infrastructure backup",
+      "short_description": "backup entire Docker Compose stacks",
+      "executable": true
+    },
+    "tools/cloud/cloudsend.py": {
+      "path": "tools/cloud/cloudsend.py",
+      "name": "cloudsend.py",
+      "type": "python script",
+      "summary": "Uploads files to NextCloud/OwnCloud public shares with optional GPG encryption support via command line interface.", 
+      "purpose": "Cloud file sharing and backup",
+      "short_description": "upload files to NextCloud public shares",
+      "executable": true
+    },
+    "tools/cloud/vqa3.py": {
+      "path": "tools/cloud/vqa3.py",
+      "name": "vqa3.py",
+      "type": "python script",
+      "summary": "AI-powered image classification using OpenAI CLIP models for content categorization with customizable classification categories.",
+      "purpose": "AI image analysis and content filtering",
+      "short_description": "AI image classifier using CLIP models",
+      "executable": true
+    }
+  }
+}

WARP.md

@@ -0,0 +1,141 @@
+# WARP.md
+
+This file provides guidance to WARP (warp.dev) when working with code in this repository.
+
+## Repository Overview
+
+This is a collection of utility scripts, tools, and gists organized for cybersecurity, forensics, data analysis, and system administration tasks. The repository contains standalone utilities rather than a cohesive application, with scripts written in Python, Bash, Go, JavaScript, PowerShell, and C.
+
+## Key Directory Structure
+
+- **`codegrab/`** - Main collection of security and analysis tools
+  - `ctf/` - CTF challenge solving scripts
+  - `puzzlebox/` - 3D puzzle solving algorithms with visualization
+- **`tools/`** - System utilities and data processing tools
+- **`config/`** - System configuration and installation scripts
+- **`systemscripts/`** - System administration and environment setup
+  - `proxy/` - Network proxy configuration utilities
+- **`dockerfiles/`** - Docker container build scripts
+- **`collected/`** - Archive of older utilities with documentation
+
+## Common Development Tasks
+
+### Running Security Analysis Tools
+
+Most security tools are standalone and follow this pattern:
+```bash
+# VirusTotal scanning
+./codegrab/scan_vt.py <filename>
+
+# Import hash calculation
+python3 codegrab/imphash.py <pe_file>
+
+# Network analysis
+./codegrab/scapy_arp.py
+./codegrab/simple_portscan.py
+```
+
+### Data Processing Utilities
+
+```bash
+# Hash utilities for archives
+python3 tools/libarchivesum.py archive.zip
+
+# Unicode character analysis
+echo "text" | python3 tools/unum.py
+
+# Domain extraction from URLs
+cat urls.txt | python3 tools/domgrep.py
+
+# File organization by MIME type
+python3 tools/rename.mime.py
+```
+
+### Docker Environment Management
+
+```bash
+# Backup Docker Compose stacks
+./tools/backup_docker.sh docker-compose.yml
+
+# Restore Docker environments
+./tools/restore_docker.sh
+
+# Build forensics containers
+./dockerfiles/build_kali.sh
+```
+
+### System Configuration
+
+```bash
+# Install dependencies and configure environment
+./config/install.sh
+
+# Proxy configuration
+./systemscripts/proxy/get_proxy.sh
+./systemscripts/proxy/update_apt_proxy.sh
+```
+
+## Architecture and Patterns
+
+### Security Tools Pattern
+Most security utilities in `codegrab/` follow this pattern:
+- Standalone executables with shebang
+- Take file paths or stdin as input
+- Output results in structured format (often CSV-like with custom separators)
+- Use external APIs (VirusTotal, etc.) with API keys from `~/.virustotal_api_key`
+
+### Data Processing Pattern
+Tools in `tools/` directory typically:
+- Accept multiple file inputs via command line arguments
+- Use argparse for option handling
+- Support multiple hash algorithms or processing modes
+- Include error handling for malformed inputs
+
+### System Scripts Pattern
+Scripts in `systemscripts/` are designed for:
+- Environment detection and configuration
+- Proxy and network setup automation
+- Service management and monitoring
+- Display and hardware management
+
+### Specialized Solvers
+The `puzzlebox/` directory contains algorithmic solvers featuring:
+- 3D spatial problem solving with numpy
+- Visualization using matplotlib
+- Recursive backtracking algorithms
+- Multi-processing optimization variants
+
+## Key Dependencies
+
+The repository relies on various Python packages that should be available:
+- **Security**: `pefile`, `requests`, `scapy`
+- **Data Processing**: `libarchive-c`, `openpyxl`, `visidata` 
+- **Scientific**: `numpy`, `matplotlib`, `scipy`
+- **Forensics**: `AnalyzeMFT`, `pymisp`
+- **System**: `ntplib`, `mac-vendor-lookup`, `dateparser`
+
+## API Keys and Configuration
+
+Several tools expect API keys in home directory files:
+- `~/.virustotal_api_key` - VirusTotal API access
+- Tools may also use environment variables for proxy configuration (`http_proxy`, etc.)
+
+## Testing and Validation
+
+Tools are typically tested individually:
+```bash
+# Test with sample data
+python3 codegrab/chechsqlite.py sample.db
+python3 tools/quickchardet.py sample.txt
+
+# Validate with CTF challenges
+python3 codegrab/ctf/solve.py
+```
+
+## Development Notes
+
+- Most utilities are designed as single-file executables for easy deployment
+- Scripts include minimal error handling suitable for command-line usage
+- Many tools output to stdout in formats suitable for piping to other commands
+- Docker-based tools assume availability of container runtime
+- Forensics tools may require elevated privileges for certain operations