Producing Streaming Video for Multiple Screen Delivery Jan's book is comprehensive and covers a wide array of topics related to streaming video, including video encoding and ABR streaming.
Digital Video and HD: Algorithms and Interfaces (The Morgan Kaufmann Series in Computer Graphics) Everything I know about analog video and its influence on digital video I learned from this book. Poynton's book is the quintessential video reference manual.
Compression for Great Video and Audio, Second Edition: Master Tips and Common Sense (DV Expert) Ben's two decades of experience in digital video and 6 years at Microsoft make him a world-renowned expert on video compression and streaming.