15,762 technical terms and definitions
megatron tensor parallel, layer parallel, intra layer parallelism, model sharding
Tensor parallelism is a model-parallel technique that splits the individual weight matrices inside a layer across multiple GPUs, so each device stores and multiplies only a slice…
megatron tensor parallel, model parallel column row, tensor parallel attention, intra layer parallelism
Tensor Parallelism is the distributed deep learning strategy that partitions individual weight matrices across multiple GPUs within a single layer — splitting the computation…
megatron tensor parallelism, column row parallelism, tensor model parallelism, attention parallelism
Tensor Parallelism is the model parallelism technique that splits individual weight matrices and tensors across multiple GPUs, with each GPU computing a portion of each layer's…
megatron tensor parallel, column row tensor split, tensor parallel attention, 1d 2d tensor parallel
Tensor Parallelism for LLM Training is a sophisticated model parallelism approach that partitions weight matrices across multiple GPUs/TPUs, enabling training…
model parallel sharding strategies, intra-layer tensor splitting, distributed matrix multiplication, megatron style tensor parallel
Tensor Parallelism for Large Models — Distributing individual tensor operations across multiple devices to train and serve models that exceed single-GPU memory capacity. Core…
model parallelism layer, intra layer parallelism, tensor model parallel, column row parallelism
Tensor Parallelism is the model parallelism technique that partitions individual layers across multiple devices by splitting weight matrices along specific dimensions — enabling…
model optimization
Tensor Train is a tensor factorization that decomposes large tensors into a sequence of low-rank core tensors - It controls parameter growth for very high-dimensional weight…
visualize, training
fastai: Making Neural Nets Uncool Again Overview fastai is a deep learning library layered on top of PyTorch. Its goal is to democratize deep learning by making it accessible…
Keras, TPU, Google Brain, computation graph, XLA, TensorFlow Lite, DistBelief, TensorFlow 2.0
TensorFlow is an open-source machine learning framework developed by the Google Brain team and released in November 2015, built around the idea of expressing numerical computation…
model optimization
TensorFlow Lite is a lightweight TensorFlow runtime for deploying optimized models on mobile and embedded systems - It supports quantization and delegated acceleration for edge…
trt, nvidia tensorrt, inference optimizer, tensorrt engine, model optimization
A compiled TensorRT engine is specifically tied to the exact particular GPU architecture and TensorRT software version it was actually compiled against, meaning that same compiled…
tensorrt inference optimization and gpu acceleration, tensorrt inference optimization, inference optimization gpu, optimization gpu acceleration, tensorrt inference
TensorRT Inference Optimization and GPU Acceleration Introduction & Motivation TensorRT Inference Optimization and GPU Acceleration addresses a central problem in TensorRT engine…
tensorrt llm, trt-llm, trt llm, tensorrtllm, llm inference nvidia, deployment
TensorRT-LLM specifically extends TensorRT's general optimization approach with additional techniques tailored specifically to large language model inference, including optimized…
teos deposition uniformity drift prediction machine learning, teos deposition, uniformity drift prediction, cmp pecvd rf teos, teos deposition uniformity drift prediction
TEOS Deposition Uniformity Drift Prediction with Machine Learning Introduction & Motivation TEOS Deposition Uniformity Drift Prediction with Machine Learning addresses a central…
THz ellipsometry, terahertz time-domain ellipsometry, THz-TDE, terahertz spectroscopic ellipsometry, magneto-terahertz ellipsometry, terahertz conductivity metrology
Terahertz ellipsometry measures polarization change at frequencies where mobile carriers, soft lattice modes, collective excitations, and low-energy dielectric relaxation can…
terahertz imaging subsurface defect detection prediction, terahertz imaging subsurface, imaging subsurface defect, subsurface defect detection
Terahertz Imaging Subsurface Defect Detection Prediction with Machine Learning Introduction & Motivation Terahertz Imaging Subsurface Defect Detection Prediction with Machine…
terahertz inspection defect prediction, terahertz inspection defect, inspection defect prediction, terahertz inspection, inspection defect, defect prediction
Terahertz Inspection Defect Prediction with Machine Learning Introduction & Motivation Terahertz Inspection Defect Prediction with Machine Learning addresses a central problem…
terahertz time-domain spectroscopy conductivity mapping prediction, terahertz time-domain spectroscopy, time-domain spectroscopy conductivity
Terahertz Time-Domain Spectroscopy Conductivity Mapping Prediction with Machine Learning Introduction & Motivation Terahertz Time-Domain Spectroscopy Conductivity Mapping…
term machine learning, Samuel 1959, Mitchell 1997 definition, learning without being explicitly programmed, experience task performance, ML definition
Machine learning is the study of computer programs whose performance on some task improves with experience, as opposed to programs whose behavior is fixed entirely by rules…
ternary cam power-per-lookup prediction, ternary cam power-per-lookup, cam power-per-lookup prediction, ternary cam, cam power-per-lookup, power-per-lookup prediction
Ternary CAM Power-per-Lookup Prediction with Machine Learning Introduction & Motivation Ternary CAM Power-per-Lookup Prediction with Machine Learning addresses a central problem…
distributed training
Ternary Gradients is a gradient quantization scheme that compresses each gradient component to one of three values: (-1, 0, +1) — achieving very high compression while preserving…
model optimization
Ternary Networks is neural networks using three weight states, typically negative, zero, and positive values - They extend binary methods with improved expressiveness at low…
ternary quantization, ternary weight networks, ttq, low-bit neural network, model compression
Ternary Neural Networks (TNNs) are quantized neural networks that restrict weights and sometimes activations to three values, typically -1, 0, and +1, creating a practical middle…
terraform state backend, terraform state, state backend
Terraform State Backend Introduction & Motivation Terraform State Backend addresses a central problem in cloud process control and state-storage-consistency-lock prediction: how…
test access system design and standardization, test access system, access system design, system design standardization, test access, access system, system design, design standardization
Test Access System Design and Standardization Introduction & Motivation Test Access System Design and Standardization addresses a central problem in test process control…
code ai
Test Case Generation from Spec is the AI task of automatically creating unit tests — input values, expected outputs, and edge case assertions — from a formal specification…
test case prioritization, test case, case prioritization
Test Case Prioritization Introduction & Motivation Test Case Prioritization addresses a central problem in verification process control…
test case versioning control, test case versioning, case versioning control, test case, case versioning, versioning control
Test Case Versioning Control Introduction & Motivation Test Case Versioning Control addresses a central problem in verification process control and version-control-latency…
test cell temperature excursion prediction machine learning, test cell, temperature excursion prediction, hvac, test cell temperature excursion prediction, cell temperature
Test Cell Temperature Excursion Prediction with Machine Learning Introduction & Motivation Test Cell Temperature Excursion Prediction with Machine Learning addresses a central…
test chamber temperature soak time prediction machine learning, test chamber, temperature soak time, test chamber temperature soak time prediction, soak time prediction
Test Chamber Temperature Soak Time Prediction with Machine Learning Introduction & Motivation Test Chamber Temperature Soak Time Prediction with Machine Learning addresses…
test contactor insertion force prediction machine learning, test contactor, insertion force prediction, test contactor insertion force prediction, test contactor insertion
Test Contactor Insertion Force Prediction with Machine Learning Introduction & Motivation Test Contactor Insertion Force Prediction with Machine Learning addresses a central…
test contactor pin wear prediction, test contactor pin, contactor pin wear, pin wear prediction, test contactor, contactor pin, pin wear, wear prediction
Test Contactor Pin Wear Prediction with Machine Learning Introduction & Motivation Test Contactor Pin Wear Prediction with Machine Learning addresses a central problem in final…
test coverage adequacy prediction, test coverage adequacy, coverage adequacy prediction, test coverage, coverage adequacy, adequacy prediction
Test Coverage Adequacy Prediction with Machine Learning Introduction & Motivation Test Coverage Adequacy Prediction with Machine Learning addresses a central problem in test…
test data compression and decompression latency, test data compression, data compression decompression, compression decompression latency, test data, data compression
Test Data Compression and Decompression Latency Introduction & Motivation Test Data Compression and Decompression Latency addresses a central problem in test process control…
test data generation database, test data generation, data generation database, test data, data generation, generation database
Test Data Generation Database Introduction & Motivation Test Data Generation Database addresses a central problem in verification process control and data-generation-time-seconds…
test documentation traceability, test documentation, documentation traceability
Test Documentation Traceability Introduction & Motivation Test Documentation Traceability addresses a central problem in verification process control…
modeling probability of test escape for reliability prediction, modeling probability test, probability test escape, test escape reliability, escape reliability prediction, probability test
Modeling probability of test escape for reliability prediction Introduction & Motivation Modeling probability of test escape for reliability prediction addresses a central problem…
manufacturing test escape risk prediction, manufacturing test escape, test escape risk, escape risk prediction, manufacturing test, test escape, escape risk, risk prediction
Manufacturing Test Escape Risk Prediction with Machine Learning Introduction & Motivation Manufacturing Test Escape Risk Prediction with Machine Learning addresses a central…
test failure diagnosis, test failure, failure diagnosis
Test Failure Diagnosis Introduction & Motivation Test Failure Diagnosis addresses a central problem in verification process control and root-cause-identification-time prediction…
code ai
Test generation automatically creates unit tests, integration tests, and other test cases for existing code, using AI to analyze function signatures, implementation logic, edge…
test handler contact wear prediction, test handler contact, handler contact wear, contact wear prediction, test handler, handler contact, contact wear, wear prediction
Test Handler Contact Wear Prediction with Machine Learning Introduction & Motivation Test Handler Contact Wear Prediction with Machine Learning addresses a central problem…
test handler pick and place accuracy prediction with machine learning, test handler pick place accuracy prediction machine learning, test handler, pick place accuracy
Test Handler Pick-and-Place Accuracy Prediction with Machine Learning Introduction & Motivation Test Handler Pick-and-Place Accuracy Prediction with Machine Learning addresses…
test handler pick-place accuracy prediction, test handler pick-place, handler pick-place accuracy, pick-place accuracy prediction, test handler, handler pick-place
Test Handler Pick-Place Accuracy Prediction with Machine Learning Introduction & Motivation Test Handler Pick-Place Accuracy Prediction with Machine Learning addresses a central…
test infrastructure provisioning, test infrastructure, infrastructure provisioning
Test Infrastructure Provisioning Introduction & Motivation Test Infrastructure Provisioning addresses a central problem in verification process control…
test insertion point optimization prediction, test insertion point, insertion point optimization, point optimization prediction, test insertion, insertion point
Test Insertion Point Optimization Prediction with Machine Learning Introduction & Motivation Test Insertion Point Optimization Prediction with Machine Learning addresses a central…
test insertion yield loss root cause prediction machine learning, test insertion, yield loss root, test insertion yield loss root cause prediction, test insertion yield
Test Insertion Yield Loss Root Cause Prediction with Machine Learning Introduction & Motivation Test Insertion Yield Loss Root Cause Prediction with Machine Learning addresses…
test isolation methodology, test isolation, isolation methodology
Test Isolation Methodology Introduction & Motivation Test Isolation Methodology addresses a central problem in verification process control and isolation-completeness-percentage…
test oracle specification, test oracle, oracle specification
Test Oracle Specification Introduction & Motivation Test Oracle Specification addresses a central problem in verification process control and oracle-correctness-guarantee…
test overkill rate prediction, test overkill rate, overkill rate prediction, test overkill, overkill rate, rate prediction
Test Overkill Rate Prediction with Machine Learning Introduction & Motivation Test Overkill Rate Prediction with Machine Learning addresses a central problem in semiconductor test…
test pattern generation and effectiveness, test pattern generation, pattern generation effectiveness, test pattern, pattern generation, generation effectiveness
Test Pattern Generation and Effectiveness Introduction & Motivation Test Pattern Generation and Effectiveness addresses a central problem in test process control…