Malus Law Explained: Polarization and Quantum Randomness

Malus law says how much polarized light gets through two polarizing filters. For single particles of light it becomes a probability, which is the first step toward quantum randomness. This post builds the idea from an everyday analogy, a formula, and a short simulation. No quantum physics background is needed. Why we start with Malus … Read more

CNN vs. FIR Filter: Visualizing Neural Network Weights for Signal Processing

Skeptical of ‘Black Box’ AI? We prove that a 1D Convolutional Neural Network (CNN) is mathematically identical to an adaptive FIR filter. Includes Python code to train a CNN to reinvent the Matched Filter and visualize its frequency response.

Shrink to Win: Regularization’s Role in Model Success

Overfitting? Shrink your model! Regularization prevents memorization, enabling true learning & robust success. Discover how. A central problem in machine learning is to develop algorithms that work well both on training data and on new inputs (test data). Most machine learning tasks can be generalized as the estimation of a function (hat{f}(X)) that maps the … Read more

Model Distillation Explained: How DeepSeek Leverages the Technique for AI Success

Model distillation, also known as knowledge distillation, is a supervised learning technique that condenses the capabilities and thought processes of a large, pre-trained “teacher” model into a smaller “student” model. This allows the student model to achieve comparable performance to the teacher model, but at a lower cost and with faster performance. Chinese AI lab … Read more

Convolutional Codes – sliding window and shift register

Key focus : Convolutional codes: Error-correcting codes effective in noisy channels and burst error correction. Know about sliding window & shift registers and how they are used in a convolutional encoder. Linear block codes: shift register Linear block codes, like Hamming codes, are mainly employed in hard decision decoding, utilizing the inherent algebraic structure of … Read more