Company
6 problems tagged for Apple.
Build numerically stable softmax using the log-sum-exp trick, handling overflow and underflow in raw tensor math.
Maintain and expand top-scoring partial sequences at each decoding step with length normalization and early stopping.
Build the InfoNCE contrastive loss and a CLIP-style training loop that aligns image and text embeddings.
Train a smaller student model to match a larger teacher's soft predictions using temperature-scaled KL divergence loss.
Draft tokens with a fast model, verify in parallel with the target model, and accept/reject to guarantee identical output distribution.
Build ViT with masked autoencoder pretraining — randomly mask patches, encode visible ones, decode to reconstruct.