32 min read

Q4 2017 IT Review: Kubernetes 1.9, AWS re:Invent, and the Service Mesh Era

Q4 2017 IT Review: Kubernetes 1.9, AWS re:Invent, and the Service Mesh Era

Part of IT Trends & Reviews — what actually shipped, quarter by quarter.

1. Introduction: The Quarter That Defines Cloud-Native

The final quarter of 2017 arrives with an unmistakable sense of momentum. In fact, three powerful forces converge simultaneously, and together they reshape how organisations build, deploy, and operate software at scale. First, Kubernetes is graduating from an ambitious open-source experiment to a production-hardened standard. Version 1.9, released on December 15, elevates the Workloads API to general availability. As a result, it signals to enterprises that the container orchestration question is settled.

Second, Amazon Web Services stages its most ambitious re:Invent conference yet. It delivers dozens of launches in Las Vegas over a single week. Most notably, Amazon SageMaker arrives as a fully managed machine-learning platform. In addition, AWS Fargate arrives as a serverless container runtime that removes the burden of managing EC2 fleets entirely. Third, Istio pushes through releases 0.2 and 0.3 this quarter. Google, IBM, and Lyft jointly launched the service mesh project. As a result, those releases establish the sidecar-proxy model as the dominant pattern for securing and observing microservice-to-microservice traffic.

Beyond infrastructure, the AI world receives a seismic shock on October 18. DeepMind publishes “Mastering the Game of Go without Human Knowledge” in Nature. The paper introduces AlphaGo Zero, a reinforcement-learning system that starts from random play with no historical game data. Within 40 days it surpasses every prior AlphaGo version. The implications reach far beyond board games. A system can teach itself superhuman mastery of a complex domain from first principles. Therefore, applications to protein folding, drug discovery, and climate modelling become genuinely credible research directions.

1.1 Bitcoin, the GPU squeeze, and the consumer side of the quarter

At the same time, the consumer internet reaches a cultural and financial fever pitch. Bitcoin crosses $10,000 on November 28 and races toward $19,783 by December 17 — its all-time high at the time. Similarly, Ethereum rises nearly fivefold during the quarter. Alibaba shatters its own Singles’ Day record with $25.3 billion in gross merchandise volume on November 11, processing 325,000 orders per second at peak. Meanwhile, Apple ships the iPhone X on November 3, introducing Face ID and an A11 Bionic chip with a dedicated Neural Engine. In addition, Mozilla releases Firefox Quantum on November 14, claiming 2× the speed of Firefox 52. Finally, the W3C finalises WebAssembly 1.0, with all four major browsers shipping support simultaneously. Overall, Q4 2017 is a quarter of arrivals in every corner of the industry. Technologies that have been maturing in the background for years are crossing into mainstream production use right now.

Dec 15
Kubernetes 1.9 released (Workloads API GA)
Nov 29
AWS SageMaker launched at re:Invent
$19,783
Bitcoin all-time high, December 17
$25.3B
Alibaba Singles’ Day GMV, 24 hours
83%
Orgs using Kubernetes in production (CNCF survey)
32
Certified Kubernetes distributions at program launch

2. GitHub Deep Dive: Key Open-Source Releases

The Q4 2017 open-source landscape is dominated by containers, service meshes, and machine-learning tooling. In practice, repositories that have been building community and contributor base throughout 2017 are now shipping the releases that matter for production adoption. Additionally, a new project — Kubeflow — arrives in December and immediately captures the imagination of ML engineers who have been trying to bridge the gap between Kubernetes and machine-learning workflows.

2.1 kubernetes/kubernetes — Version 1.9

Kubernetes 1.9 — Apps Workloads GA and Expanded Ecosystem

Released: December 15, 2017 · GitHub: github.com/kubernetes/kubernetes

Kubernetes 1.9 is the fourth and final release of the year, and it is the most consequential. The apps/v1 Workloads API reaches General Availability, stabilising Deployment, ReplicaSet, DaemonSet, and StatefulSet under a single versioned API group. As a result, this GA designation removes the last technical reservation many enterprise architects have about running mission-critical applications on Kubernetes. Deployments and ReplicaSets are the most-used objects in the ecosystem. In addition, their transition to stable means that organisations can rely on long-term backwards-compatibility guarantees.

Windows Server support moves to beta, opening the platform to organisations that run Windows-based workloads. The Container Storage Interface (CSI) lands in alpha, beginning the journey toward a standards-based storage plug-in model. CoreDNS enters alpha, offering a more extensible alternative to kube-dns. In addition, IPVS mode for kube-proxy reaches beta, delivering better scalability for large clusters. Finally, Custom Resource Definition (CRD) validation graduates to beta. The project reports over 75,000 comments on GitHub this quarter. In addition, a CNCF survey finds that 83 per cent of organisations are running Kubernetes in production.

Kubernetes logo representing version 1.9 GA release in December 2017
Kubernetes logo. Version 1.9, released December 15 2017, promotes the apps/v1 Workloads API to General Availability and adds Windows Server beta support. Source: CNCF Artwork repository / Apache 2.0 license.

2.2 istio/istio — Releases 0.2 and 0.3

Istio — The Service Mesh That Reimagines Microservice Networking

Releases: 0.2 (September 2017), 0.3 (November 2017) · GitHub: github.com/istio/istio

Istio is building momentum rapidly. The project is a collaboration between Google, IBM, and Lyft — Lyft engineers created the Envoy proxy that serves as Istio’s data-plane sidecar. Release 0.3 ships in November. It brings improvements to mutual TLS (mTLS) certificate rotation and a more stable Mixer policy and telemetry pipeline. In addition, integration with Prometheus and Grafana improves for observability. Put simply, the core proposition is clear: inject an Envoy sidecar into every pod. In addition, you get automatic mTLS encryption, fine-grained traffic control (canary deployments, A/B testing, circuit breaking), and rich distributed tracing — without changing a line of application code.

Istio answers questions that Kubernetes alone does not solve: How do services authenticate to each other? How do you implement rate-limiting or retries uniformly across all services? How do you get distributed tracing across a polyglot stack? As a result, the concept of a service mesh as a separate infrastructure layer crystallises this quarter into an architectural pattern that many organisations intend to adopt.

Istio service mesh logo representing the 0.3 release in November 2017
Istio service mesh logo. Istio 0.3, released November 2017, advances mTLS, traffic management, and Prometheus integration. Source: CNCF Artwork repository / Apache 2.0 license.

2.3 facebook/react — The Fiber Architecture Settles In

React 16 — Fiber Architecture Reaches the Enterprise

React 16.x stable · GitHub: github.com/facebook/react

React 16 ships on September 26 and enters Q4 2017 as the hottest topic in frontend engineering. The Fiber architecture is a complete rewrite of React’s core reconciler. It replaces the old synchronous, recursive stack-based algorithm with an incremental, priority-based linked-list structure. React can now pause, resume, and prioritise rendering work, preventing long tasks from blocking the main thread. Error boundaries allow components to catch JavaScript errors in their subtree and render fallback UIs instead of crashing the application. In addition, Portals enable rendering children into a DOM node outside the parent hierarchy, addressing modals and tooltips. Similarly, Fragments let components return multiple elements without a wrapper div. React 16 also ships with an MIT licence, resolving the licensing controversy that threatened enterprise adoption earlier in 2017.

React logo representing the React 16 Fiber release adopted across enterprise in Q4 2017
React logo. React 16, featuring the Fiber reconciler, enters widespread enterprise adoption and broader community acceptance in Q4 2017. Source: Wikimedia Commons — Facebook / Public domain.

2.4 tensorflow/tensorflow — Version 1.4 with TFLite Preview

TensorFlow 1.4 — Mobile Inference and Platform Maturity

Version 1.4, November 2017 · GitHub: github.com/tensorflow/tensorflow

TensorFlow 1.4 ships in November and includes an important preview: TensorFlow Lite, a lightweight solution for mobile and embedded inference. TFLite uses a new FlatBuffers-based model format that loads faster than the standard protobuf format and produces smaller binaries — a critical property for Android and iOS deployment. In addition, the Datasets and Estimators APIs are substantially improved, making it easier to write production ML pipelines. Keras is bundled as tf.keras, reducing friction for high-level API access within TensorFlow. Notably, the project reaches over 75,000 GitHub stars this quarter, making it one of the most-starred repositories on the platform.

TensorFlow logo representing the 1.4 release with TFLite preview in November 2017
TensorFlow logo. TensorFlow 1.4, released November 2017, introduces TensorFlow Lite preview for mobile inference and bundles Keras as tf.keras. Source: Wikimedia Commons — Google LLC / Apache License 2.0.

2.5 kubeflow/kubeflow — A New ML Platform Is Born

Kubeflow — Composable, Portable, Scalable ML on Kubernetes

Announced: December 2017 · GitHub: github.com/kubeflow/kubeflow

Announced on the Kubernetes blog in December 2017, Kubeflow addresses a pain point that many ML practitioners are experiencing: running machine-learning workloads on Kubernetes is possible. However, it requires significant custom tooling to assemble. Kubeflow provides JupyterHub for interactive notebooks, a TensorFlow Training Controller for distributed training jobs, and a TensorFlow Serving deployment component. The project is opinionated enough to provide a useful starting point. Yet it stays composable enough to adapt to different cloud providers and on-premise environments. Overall, the launch reflects a broader industry conviction that Kubernetes should become the universal compute substrate not just for web services, but for the entire ML lifecycle.

2.6 serverless/serverless — Framework v1.26

Serverless Framework — Multi-Cloud Production Maturity

Version 1.26, Q4 2017 · GitHub: github.com/serverless/serverless

The Serverless Framework continues its evolution as the de facto standard for defining and deploying event-driven functions. Version 1.26 and surrounding point releases in Q4 2017 improve multi-provider support. That support covers AWS Lambda, Google Cloud Functions, Microsoft Azure Functions, and IBM OpenWhisk. All of them sit under a single YAML-based configuration model. In addition, the framework’s plugins ecosystem reaches over 400 community plugins. Notably, enterprise teams are now deploying production workloads using the framework, attracted by its infrastructure-as-code approach and rich deployment pipeline support. The announcement of AWS Fargate and further Lambda improvements at re:Invent further energises the serverless community.

Serverless Framework logo representing the multi-cloud maturity in Q4 2017
AWS Lambda logo — the primary platform targeted by the Serverless Framework. Version 1.26 ships in Q4 2017 with improved multi-cloud support across AWS Lambda, GCP Functions, Azure Functions, and IBM OpenWhisk. Source: Wikimedia Commons — Amazon.com, Inc. The original uploader was Balise42 at English Wikipedia. / Public domain.
RepositoryKey Q4 2017 ReleaseSignificanceTag
kubernetes/kubernetesv1.9 — Workloads API GA, CSI alpha, Windows betaContainer orchestration becomes enterprise-grade standardContainers
istio/istio0.3 — mTLS, Mixer, Prometheus integrationService mesh pattern solidifies; sidecar proxy as de facto modelService Mesh
facebook/react16.x — Fiber, error boundaries, portals, MIT licenceIncremental rendering resolves long-running-task UX problemsFrontend
tensorflow/tensorflow1.4 — TFLite preview, tf.keras, Estimators APIML inference expands from servers to mobile devicesAI/ML
kubeflow/kubeflowInitial launch — JupyterHub, TF Training, TF Serving on K8sKubernetes becomes the substrate for end-to-end ML workflowsAI/ML
serverless/serverlessv1.26 — 400+ plugins, multi-cloud supportFunction-as-a-Service reaches enterprise production deploymentsServerless

3. Big Tech & Industry Breakthroughs

Q4 2017 is one of the densest quarters in recent memory for major product launches. For example, AWS’s re:Invent alone accounts for over 60 new service announcements. Similarly, Apple’s iPhone X reframes the smartphone as a biometric computing device. In addition, Alibaba’s Singles’ Day demonstrates cloud infrastructure at a scale that most engineers have only imagined. Meanwhile, Mozilla and the W3C deliver browser and standards improvements that change what is possible on the web. The following table captures the most consequential events by company and region, covering the United States, Europe, and Asia.

Company / OrgEventDateSignificance
Google DeepMind (UK)AlphaGo Zero paper published in NatureOct 18AI masters Go from scratch, with no human data — signals superhuman capability in structured domains without prior knowledge
Amazon AWS (USA)Amazon SageMaker launched at re:InventNov 29Fully managed ML platform democratises model training and deployment; removes infrastructure burden from data scientists
Amazon AWS (USA)AWS Fargate announcedNov 29Serverless containers: run ECS/EKS workloads without managing EC2 instances; fundamentally changes the container operations model
Amazon AWS (USA)Amazon EKS preview announcedNov 29Managed Kubernetes on AWS signals hyperscaler endorsement; container orchestration war effectively ends
Amazon AWS (USA)AWS DeepLens developer kit announcedNov 29First deep-learning-enabled developer video camera; runs local inference models; democratises computer vision prototyping
Amazon AWS (USA)Amazon Rekognition Video, Transcribe, Translate announcedNov 29AI-as-API services lower the barrier to real-time video analysis, speech-to-text, and neural machine translation
Amazon AWS (USA)AWS Cloud9 cloud IDE launchedNov 29Browser-based development environment with Lambda debugging; cloud IDE concept gains major-platform legitimacy
Amazon AWS (USA)Amazon Neptune graph database announcedNov 29Managed graph database supporting Gremlin and SPARQL; first major cloud-managed graph offering
Apple (USA)iPhone X launchedNov 3Face ID via TrueDepth camera; A11 Bionic with Neural Engine; OLED display; resets smartphone design and AI-on-device expectations
CNCF (USA/Global)Certified Kubernetes Conformance Program launchedNov 1332 certified distributions and platforms; portability guarantees drive enterprise adoption and prevent vendor lock-in
Mozilla (USA)Firefox Quantum (v57) releasedNov 14New Stylo CSS engine from Servo project; 2× faster than Firefox 52; 30% less memory than Chrome — browser competition reignites
W3C / Browsers (Global)WebAssembly 1.0 MVP ships in all major browsersNov 2017Chrome, Firefox, Safari, Edge all ship Wasm simultaneously; opens web to near-native execution of C/C++/Rust code
Alibaba (China)Singles’ Day: $25.3B GMV in 24 hoursNov 11325,000 orders/second peak on Alibaba Cloud; demonstrates Chinese hyperscaler leadership at unprecedented scale
Google (USA)Kubeflow initial launchDec 2017ML workflows brought natively to Kubernetes; positions K8s as the universal compute substrate for training and serving
Microsoft (USA/EU)Visual Studio Code 1.18–1.19 shippedOct–Nov 2017Multi-root workspaces, TypeScript 2.6, Git log viewer; VS Code firmly establishes itself as the most popular developer editor
CNCF / KubeCon (USA)KubeCon + CloudNativeCon AustinDec 6–8Largest Kubernetes conference to date; Kelsey Hightower’s keynote demos cement Kubernetes as production-ready for any workload

3.1 AWS re:Invent 2017: The Biggest Cloud Week Ever

AWS re:Invent runs November 27 to December 1 at the Venetian and Sands Expo Convention Centre in Las Vegas. CEO Andy Jassy’s keynote exceeds three hours and includes over 30 individual service announcements. Above all, the dominant theme is machine learning democratisation: Amazon’s goal is to enable every developer to build ML-powered applications without requiring a doctorate in data science.

SageMaker is the centrepiece. It provides a fully managed environment for building, training, and deploying ML models. That environment includes managed Jupyter notebooks and a built-in set of high-performance algorithms. Those cover XGBoost, linear learner, and factorisation machines, among others. In addition, one-click deployment sends trained models to HTTPS endpoints backed by auto-scaling. The pricing model is pay-per-training-second with no upfront commitment, making it accessible even for small teams. Moreover, SageMaker includes automatic model tuning — Bayesian hyperparameter optimisation — that runs experiments in parallel to find optimal hyperparameter configurations without manual iteration.

3.2 Fargate and the EKS preview

Fargate directly addresses the most common operational complaint about containers: the requirement to manage EC2 instances, patch their operating systems, and forecast their capacity. In practice, Fargate removes this entirely. In practice, you specify CPU and memory for a task definition, and AWS runs it without exposing underlying hosts. The announcement triggers an immediate re-evaluation among operations teams debating ECS versus Kubernetes. Fargate suggests that Amazon’s answer to operational simplicity is to make the infrastructure invisible. Amazon is not competing on orchestrator features.

Free ebook

Free AI Video, Generated Locally

Working scripts and measured benchmarks. Free.

No spam. Unsubscribe at any time.

The EKS preview is arguably the most strategically significant announcement. AWS has been running its own ECS container service since 2015. Therefore, the EKS announcement signals a capitulation to community momentum: Kubernetes has won the container orchestration war, and AWS must offer a managed control plane. When EKS reaches GA in mid-2018, the combination of EKS and Fargate becomes the preferred deployment target for many cloud-native organisations that previously hesitated to adopt Kubernetes on AWS.

3.3 Europe and Asia: Converging on the Cloud-Native Standard

European organisations are accelerating cloud-native adoption this quarter, driven partly by GDPR preparation (the regulation takes effect in May 2018) and partly by the proliferation of mature tooling. For example, several large German and Nordic banks announce Kubernetes pilots. In addition, the German automotive industry, led by BMW and Volkswagen, begins evaluating Kubernetes for connected-vehicle data pipelines. Notably, the CNCF’s Certified Kubernetes Programme, with its cross-vendor portability guarantees, addresses the concern European enterprises have about vendor lock-in.

In China, Tencent operates tens of thousands of Kubernetes nodes for its gaming and social media workloads. Similarly, Alibaba Cloud announces expanded Kubernetes support across its Container Service, reflecting convergence on the same orchestration standard as Western hyperscalers. In addition, the Baidu AI Platform is expanding its cloud-native infrastructure this quarter. Chinese cloud providers adopt Kubernetes while also outpacing Western peers in Singles’ Day scale benchmarks. That dual narrative illustrates something important. The cloud-native stack is becoming a global standard rather than a US-centric phenomenon.

Key Insight: The Container Orchestration War Is Over

By the end of Q4 2017, the question of which container orchestrator to adopt is effectively decided. Docker Swarm, Apache Mesos/DC/OS, and HashiCorp Nomad remain active projects. However, the CNCF survey result — 83% of organisations running Kubernetes in production — and Amazon’s EKS preview together confirm that Kubernetes is the industry standard. The discussion shifts from “which orchestrator?” to “how do we operate Kubernetes well at scale?” Teams still evaluating alternatives are now a minority.

4. AI & Technology Impact

Q4 2017 is a pivotal moment in applied machine learning. Two trends run in parallel. First, academic AI research produces breakthroughs that challenge long-held assumptions about the amount of human supervision machine learning requires. Second, cloud providers translate these breakthroughs into managed services that remove the infrastructure and expertise barriers for the average developer. The result is a quarter where AI moves from a specialist discipline to a broadly accessible engineering capability.

4.1 Timeline of Key AI Events

October 18, 2017

AlphaGo Zero Published in Nature

DeepMind publishes “Mastering the Game of Go without Human Knowledge” in Nature (doi:10.1038/nature24270). AlphaGo Zero learns purely through self-play, using a single neural network and Monte Carlo Tree Search with no human game data. It defeats the version that beat world champion Lee Sedol by 100 games to 0 after three days of training. After 40 days it surpasses “Master,” which had defeated the world’s top-ranked players. The result is immediately recognised as a landmark in reinforcement learning: superhuman performance in a complex structured domain is achievable without human knowledge as input.

November 2, 2017

WebAssembly 1.0 Ships in All Major Browsers Simultaneously

The W3C WebAssembly Community Group announces that Chrome 57, Firefox 52, Safari 11, and Edge 16 all ship WebAssembly MVP support in coordinated fashion. WebAssembly is a binary instruction format for a stack-based virtual machine, designed as a compilation target for C, C++, and Rust. In practice, it runs at near-native speed in the browser, making it practical to port game engines, image editors, scientific computing libraries, and ML inference runtimes to the web. Notably, the simultaneous cross-browser ship is unprecedented in web standards history.

November 3, 2017

Apple iPhone X: Neural Engine on Consumer Hardware

Apple ships the iPhone X with the A11 Bionic chip. The A11 includes a dedicated Neural Engine capable of performing 600 billion operations per second, enabling Face ID’s real-time depth-map facial recognition. This is the first mass-market consumer device with a dedicated AI inference accelerator. Apple’s on-device AI strategy — perform inference locally rather than in the cloud — contrasts sharply with the cloud-AI approach and raises important questions about privacy, latency, and inference economics. Those questions will define AI architecture discussions for years.

4.2 Q4 2017 timeline: mid-November to re:Invent

November 14, 2017

Firefox Quantum: Parallel CSS Engine from Rust

Mozilla releases Firefox 57 (“Firefox Quantum”) with a new parallel CSS engine named “Stylo,” developed as part of the Servo research browser. Stylo exploits multi-core CPUs by parsing and applying CSS rules on multiple threads simultaneously. In practice, Mozilla reports 2× the speed of Firefox 52 and 30% less memory than Chrome in comparable workloads. Overall, the release reinvigorates browser competition and demonstrates that Rust, the language Servo and Stylo are written in, can deliver systems-programming performance in a large-scale production codebase.

November 2017

TensorFlow 1.4 and TFLite Preview

TensorFlow 1.4 ships with TensorFlow Lite preview, using a new FlatBuffers-based model format for faster loading and smaller binaries on Android and iOS. The Keras integration as tf.keras dramatically lowers the barrier for new practitioners. In addition, the Estimators API gains improvements for production ML pipeline construction. Combined with AWS SageMaker’s launch, November 2017 marks the moment when ML tooling reaches a level of maturity that justifies serious production investment across the industry.

November 27–December 1, 2017

AWS re:Invent 2017: SageMaker, Fargate, EKS, DeepLens

Amazon Web Services launches over 60 services and features at re:Invent in Las Vegas. Notably, the headline AI announcements include Amazon SageMaker (November 29), Amazon Rekognition Video, Amazon Transcribe, Amazon Translate, and AWS DeepLens — a deep-learning-enabled developer video camera. Werner Vogels frames his keynote around two convictions. The first is that every application will soon incorporate ML. The second is that AWS’s mission is to remove every barrier between a developer and an ML-powered feature.

4.3 Q4 2017 timeline: crypto peak and KubeCon

November–December 2017

Cryptocurrency Market Hits All-Time Highs

Bitcoin crosses $10,000 on November 28 and reaches approximately $19,783 on December 17 — its historical all-time high. Similarly, Ethereum rises from approximately $300 to over $700 during the quarter. Meanwhile, CryptoKitties, an Ethereum-based collectibles game, launches December 2 and immediately congests the Ethereum network, demonstrating the severe scalability limitations of public blockchains and triggering urgent discussions about sharding and layer-two solutions. As a result, GPU prices surge as cryptocurrency miners and AI data centres compete for Nvidia hardware.

December 6–8, 2017

KubeCon + CloudNativeCon Austin

The largest Kubernetes gathering to date convenes at the Austin Convention Centre. Kelsey Hightower delivers his signature live-demo keynote, running serverless workloads on Kubernetes in real time and demonstrating Istio traffic management. In addition, session tracks cover security (RBAC, network policies), ML (Kubeflow launch), storage (CSI), and multi-cloud federation. Session recordings are published to the CNCF YouTube channel. Overall, the energy signals that the Kubernetes ecosystem has crossed from early adopters to early majority.

December 15, 2017

Kubernetes 1.9 Released — Workloads API GA

The Kubernetes project, led by release team lead Anthony Yeh (Google), ships version 1.9 with the apps/v1 Workloads API at General Availability. DaemonSet, Deployment, ReplicaSet, and StatefulSet are now stable. Windows Server support enters beta. The Container Storage Interface lands in alpha. In addition, a CNCF survey finds 83% of organisations run Kubernetes in production, confirming the platform has crossed the production readiness threshold for the enterprise majority.

4.4 Q4 2017 timeline: PyTorch 0.3 and the framework race

December 2017

PyTorch 0.3 and Growing Research Adoption

Facebook’s PyTorch releases version 0.3 with improved ONNX (Open Neural Network Exchange) support for interoperability with other ML frameworks. PyTorch’s dynamic computation graph model allows network architectures to change at runtime. It is gaining rapid adoption in academic research. There, flexibility to experiment is more important than static graph optimisation. By end of Q4 2017, PyTorch and TensorFlow are the two dominant ML frameworks. In addition, a growing cohort of NLP researchers prefer PyTorch for its Pythonic API and easier debugging experience.

4.5 The Hardware Dimension: GPU Scarcity and Custom Silicon

Q4 2017 is the quarter when the GPU supply chain begins to show strain. Two pressures bid up Nvidia GPU prices across both consumer and enterprise channels. The first is cryptocurrency mining, particularly Ethereum, which is GPU-minable. The second is accelerating AI training workloads. AWS launches P3 instances based on Nvidia Tesla V100 (Volta architecture) GPUs in October 2017. Each V100 delivers approximately 14 TFLOPS of FP32 performance and 112 TFLOPS of Tensor Core performance — a dramatic step above the P2 instances’ K80 GPUs. However, P3 instance availability is constrained by Nvidia’s production capacity, and data scientists at large organisations discover that obtaining GPU quota for training runs is a competitive, rationed exercise.

Google’s Cloud TPU (Tensor Processing Unit) is available in beta on Google Cloud Platform this quarter. The TPU is Google’s custom ASIC for accelerating TensorFlow workloads, and early benchmarks show it is substantially faster than contemporary GPUs for training large neural networks. The TPU signals that the era of general-purpose GPU dominance in ML training may eventually give way to custom silicon. That trajectory will reshape the semiconductor industry over the following years. Apple’s Neural Engine in the A11 Bionic, processing 600 billion operations per second for on-device Face ID inference, reinforces the same trend at the edge.

4.6 What the four developments add up to

Key Insight: Machine Learning Is No Longer Optional

Four developments point the same way in Q4 2017. They are AlphaGo Zero’s demonstration of autonomous learning, AWS SageMaker’s democratised platform, TensorFlow 1.4’s mobile inference story, and Apple’s Neural Engine. Together they make one conclusion inescapable. Machine learning is not a specialised research tool but a standard component of the software engineering toolkit. The infrastructure — managed notebooks, managed training clusters, managed serving endpoints — is available to any team with a cloud account. Teams that do not begin building ML competency now are creating a competitive gap that only widens.

5. Key Voices & Thought Leaders

Q4 2017 is rich with influential technical voices. Four venues stand out: the KubeCon stage, the AWS re:Invent keynote, DeepMind’s Nature publication, and the React 16 release notes. Each provides moments where specific individuals define how the broader engineering community understands this quarter.

Kelsey Hightower — Google Staff Engineer

Platform: Twitter (@kelseyhightower), KubeCon keynotes, GitHub · KubeCon Austin, December 6–8, 2017

Kelsey Hightower is the most visible Kubernetes evangelist in the world. His KubeCon Austin keynote is a live-demonstration tour-de-force. He deploys serverless functions on Kubernetes and shows Istio traffic shaping in real time. Moreover, he demonstrates “Kubernetes the Hard Way” concepts in accessible, theatrical fashion. His GitHub repository kubernetes-the-hard-way becomes the definitive guide for engineers who want to understand Kubernetes from first principles. In fact, every major blog post about service meshes and cloud-native patterns this quarter either cites or references his talks. Hightower’s influence extends well beyond the conference. His keynote clips circulate widely on Twitter. They solidify the narrative that Kubernetes is not just a technology but a platform for the future.

Werner Vogels — CTO, Amazon Web Services

Platform: Twitter (@Werner), All Things Distributed blog, AWS re:Invent keynote · November 2017

Werner Vogels’s re:Invent keynote defines the AI narrative for Q4 2017. His central argument has two parts. The first is that every application built in the next decade will incorporate machine learning. The second is that AWS’s role is to remove every infrastructure obstacle between a developer’s idea and a deployed ML model. He frames SageMaker as the elimination of “undifferentiated heavy lifting” in ML infrastructure. That framing resonates strongly with enterprise customers. Many of them have been discouraged by the complexity of managing training clusters and serving infrastructure. Vogels also publishes through his All Things Distributed blog. There, technical deep-dives cover distributed systems, eventual consistency, and microservices patterns. They reach an audience of architects and engineers who consider the blog required reading.

5.1 Framework and research voices

Dan Abramov — React Core Team, Facebook

Platform: Twitter (@dan_abramov), Medium, React documentation · React 16 adoption and Fiber explanation

Dan Abramov is the primary communicator for the React 16/Fiber release. His blog posts and Twitter threads explain the Fiber reconciler in terms that non-compiler-engineers can understand. React builds a work-in-progress tree of “fibres”, or units of work. It can pause and resume that tree based on priority. Previously it committed the entire reconciliation recursively, in one synchronous pass. Abramov’s ability to make concurrent programming concepts accessible drives enormous Q4 2017 adoption of React 16 features across the frontend community. Moreover, he maintains Create React App. As a result, React 16 becomes the default starting point for new projects within days of the stable release. His writing style — patient, example-driven, never condescending — makes him one of the most effective technical communicators in the JavaScript ecosystem.

David Silver — Lead Researcher, DeepMind

Platform: Nature journal, DeepMind blog, academic lectures · AlphaGo Zero paper, October 18, 2017

David Silver is the lead author of the AlphaGo Zero Nature paper and the lead researcher of the AlphaGo programme. His work triggers a broader re-evaluation of how much human knowledge is necessary to achieve superhuman performance in structured domains. Silver’s research combines deep neural networks and Monte Carlo Tree Search, trained purely through self-play. That combination surpasses all human-knowledge-seeded AlphaGo versions. Moreover, it discovers entirely novel game strategies that human players have never considered. The DeepMind blog post accompanying the paper is accessible enough to drive non-specialist coverage across major technology publications worldwide, bringing reinforcement learning into mainstream awareness.

5.2 Architecture writing that frames the quarter

Martin Fowler — Chief Scientist, ThoughtWorks

Platform: martinfowler.com, ThoughtWorks Technology Radar · Microservices and service mesh architecture patterns

Martin Fowler’s website is one of the highest-authority sources on enterprise software architecture. In Q4 2017, the ThoughtWorks Technology Radar places service meshes in the “assess” category, meaning teams should begin evaluating them for production use. Fowler’s canonical writing on microservices — particularly patterns around circuit breakers, bulkhead isolation, and service-to-service authentication — aligns closely with what Istio delivers out of the box. His “strangler fig” migration pattern, for incrementally decomposing monoliths into microservices, is widely referenced as organisations plan their Kubernetes and Istio adoption. Fowler’s influence operates through the canonical reference posts on martinfowler.com, which practitioners link when justifying architectural decisions to their organisations and management.

6. Trend Synthesis

Standing at the end of Q4 2017 and examining the totality of the quarter’s events, a coherent narrative emerges. The industry is converging on a new architectural stack — call it the cloud-native stack — and the components of that stack are reaching production maturity simultaneously. Kubernetes 1.9 is the orchestration layer. Istio is the networking and security layer. SageMaker and TensorFlow/Kubeflow are the ML platform layer. The Serverless Framework and AWS Lambda/Fargate are the compute abstraction layer. React 16 and WebAssembly are the client-side execution layer. Each component is being hardened by thousands of practitioners this quarter, and the interactions between them are producing emergent capabilities.

The service mesh story is particularly significant for teams building distributed systems. For the past three years, the microservices movement has created a distribution of teams. Each operates their own services. Moreover, each needs to solve the same cross-cutting concerns: authentication, encryption, distributed tracing, load balancing, circuit breaking. The traditional answer has been to embed these concerns in libraries — Netflix OSS, Spring Cloud — and accept the language lock-in and upgrade coordination overhead that entails.

Istio proposes a fundamentally different answer: move these concerns out of the application layer entirely and into the infrastructure layer, via a sidecar proxy that every service receives automatically. This is not merely a convenience. It is an architectural paradigm shift that enables platform teams to enforce security and observability policies without modifying application code. The implications for large engineering organisations — where platform teams and application teams have historically had difficulty coordinating on cross-cutting concerns — are profound.

6.1 ML democratisation and the cryptocurrency spillover

The machine learning democratisation trend is equally transformative. Six months ago, running a distributed TensorFlow training job on a GPU cluster required deep infrastructure expertise. Today, a data scientist with an AWS account can launch a SageMaker training job in under ten minutes. That comes with spot-instance pricing and automatic hyperparameter tuning. In addition, one-click model deployment reaches a load-balanced HTTPS endpoint. The activation energy required to build ML-powered features has dropped by an order of magnitude. Teams that previously dismissed ML as “something Google does” are now seriously evaluating it as a competitive differentiator. The key challenge is no longer infrastructure access but data quality, problem framing, and evaluation discipline.

The cryptocurrency market frenzy, while distinct from the infrastructure story, has real consequences for the broader technology ecosystem. GPU availability is tightening, and this scarcity is creating incentives for cloud providers to invest in custom AI silicon. Google’s TPU and Apple’s Neural Engine both point toward an era where dedicated AI accelerators supplement and eventually partially displace general-purpose GPUs for inference workloads. More broadly, the speculative fever around blockchain tokens is drawing developer attention to smart contract platforms. The CryptoKitties congestion of Ethereum provides the most visible public demonstration yet that blockchain scalability is an unsolved engineering problem. Ethereum developers are already debating sharding, proof-of-stake, and layer-two solutions.

6.2 On-device inference and what the quarter settles

Finally, the consumer hardware dimension deserves sustained attention. The iPhone X’s Neural Engine is the first indicator of a trend that will define the next decade: AI inference is moving to the edge. As smartphones, embedded devices, and IoT hardware gain dedicated neural processing units, the workload split between cloud-hosted training and edge-hosted inference becomes a primary architectural consideration. Three things now point the same way: TFLite (mobile TensorFlow), Core ML (Apple’s on-device ML framework introduced with iOS 11), and the Neural Engine in the A11 Bionic. Together they suggest a shift by the early 2020s. The question for any new application will no longer be “should we use ML?”. Instead it will be “where should the ML run — on the device, at the edge, or in the cloud?”

Key Insight: The Cloud-Native Stack Reaches Enterprise Maturity

Q4 2017 is the quarter when the cloud-native architectural stack simultaneously reaches a level of maturity that justifies serious enterprise adoption. Kubernetes 1.9 provides stability guarantees. The CNCF Certified Kubernetes Programme provides portability guarantees. SageMaker makes ML infrastructure a commodity. Istio makes microservice security and observability infrastructure-level concerns. Teams that begin investing in these skills now are building the capabilities that will define their organisations’ competitive position through the early 2020s.

7. Summary

Q4 2017 closes a remarkable year for cloud-native infrastructure and applied AI. Kubernetes 1.9 is released on December 15 by a team led by Anthony Yeh at Google. It delivers the production stability guarantees that enterprise architects have been waiting for since Kubernetes 1.0 in 2015. The apps/v1 Workloads API reaching General Availability means that Deployment, ReplicaSet, DaemonSet, and StatefulSet are now stable, versioned contracts with long-term backwards-compatibility promises. The CNCF’s Certified Kubernetes Conformance Programme, launched November 13 with 32 distributions and platforms, provides the vendor-neutral portability guarantees that prevent cloud-provider lock-in and drive enterprise confidence. KubeCon Austin, the largest Kubernetes event to date, signals a community that has unambiguously crossed from early adopter to early majority in the technology adoption lifecycle.

AWS re:Invent 2017 redefines what a cloud platform launch event can be. Amazon SageMaker, AWS Fargate, Amazon EKS, AWS Cloud9, and Amazon Neptune all arrive in a single week. So do Amazon Rekognition Video, Amazon Transcribe, Amazon Translate, and AWS DeepLens. Collectively they lower the barrier to machine learning, container operations, and full-stack development. The SageMaker launch is a watershed moment: managed ML infrastructure is now a commodity, not a competitive differentiator. The real competition moves to model quality, data strategy, and the ability to embed ML predictions into user-facing products. What counts is embedding them in ways that genuinely change user behaviour.

7.1 AlphaGo Zero and the open questions

In AI research, AlphaGo Zero’s October 18 Nature paper is the defining scientific event of the quarter. A reinforcement-learning system reaches superhuman performance through pure self-play. It starts from random moves, with no human game data whatsoever. That demonstration extends the theoretical scope of what machine learning is expected to achieve. AlphaGo Zero contributes three key architectural insights. They are unified policy-and-value networks, MCTS guided by deep neural networks, and a self-play curriculum. Those insights are beginning to influence applied research in robotics, protein structure prediction, and combinatorial optimisation. The paper carries a broader message. Superhuman intelligence in complex domains is achievable without human knowledge as input. That message resonates far beyond Go and shapes how AI researchers frame their ambitions.

Several questions remain unanswered as Q4 closes. First, how will the service mesh ecosystem evolve? Will Istio remain dominant, or will simpler alternatives emerge to compete for teams that find Istio operationally complex? How will the EU GDPR, taking effect in May 2018, reshape data architecture and cloud adoption in Europe? Will Bitcoin’s price trajectory reverse, and if so, what happens to GPU supply chains and the cryptocurrency developer ecosystem? Second, how quickly will AWS EKS, Azure AKS, and Google GKE mature into the preferred managed Kubernetes options? Will that accelerate adoption among organisations that have hesitated to manage the control plane themselves?

7.2 The practical takeaway

For engineers and architects watching this quarter, the practical takeaway is unambiguous: begin building cloud-native skills in earnest. The tools are no longer experimental. They are production-ready, enterprise-supported, and backed by the largest cloud providers on the planet. GDPR compliance, ML feature development, microservice security, and operational simplicity are all pressing needs that the cloud-native stack addresses directly. Teams that invest in Kubernetes, Istio, and ML platform skills now are building capabilities that will remain differentiating through the early 2020s.

Ethereum logo representing the cryptocurrency price surge in Q4 2017 when Bitcoin reached $19,783
Ethereum logo. In Q4 2017, both Bitcoin and Ethereum reach all-time highs, driving GPU scarcity and bringing mainstream awareness to blockchain technology. Source: Wikimedia Commons — Ethereum Foundation / CC BY 3.0.

8. Sources


  1. Kubernetes Blog — “Kubernetes 1.9: Apps Workloads GA and Expanded Ecosystem” (December 15, 2017)

    https://kubernetes.io/blog/2017/12/kubernetes-19-workloads-expanded-ecosystem/

  2. CNCF — “Cloud Native Computing Foundation Launches Certified Kubernetes Program, 32 Conformant Distributions and Platforms” (November 13, 2017)

    https://www.cncf.io/announcement/2017/11/13/cloud-native-computing-foundation-launches-certified-kubernetes-program-32-conformant-distributions-platforms/

  3. DeepMind Blog — “AlphaGo Zero: Starting from Scratch” (October 18, 2017)

    https://deepmind.google/blog/article/alphago-zero-starting-scratch

  4. Nature — Silver D et al., “Mastering the Game of Go without Human Knowledge,” Nature 550, 354–359 (October 19, 2017)

    https://www.nature.com/articles/nature24270

  5. Wikipedia — Amazon SageMaker (launch date: November 29, 2017)

    https://en.wikipedia.org/wiki/Amazon_SageMaker

  6. TechCrunch — “AWS releases SageMaker to make it easier to build and deploy machine learning models” (November 29, 2017)

    https://techcrunch.com/2017/11/29/aws-releases-sagemaker-to-make-it-easier-to-build-and-deploy-machine-learning-models/

  7. Kubernetes Blog — “Introducing Kubeflow — A Composable, Portable, Scalable ML Stack Built for Kubernetes” (December 2017)

    https://kubernetes.io/blog/2017/12/introducing-kubeflow-composable/

  8. Istio GitHub — Release notes for Istio 0.2 and 0.3 (September–November 2017)

    https://github.com/istio/istio/releases

  9. React Blog — “React v16.0” (September 26, 2017)

    https://legacy.reactjs.org/blog/2017/09/26/react-v16.0.html

  10. TensorFlow GitHub — Release notes for TensorFlow 1.4 (November 2017)

    https://github.com/tensorflow/tensorflow/releases/tag/v1.4.0

  11. Mozilla Blog — “Firefox Quantum is here!” (November 14, 2017)

    https://blog.mozilla.org/en/mozilla/introducing-firefox-quantum/

  12. WebAssembly.org — WebAssembly Roadmap and browser support status

    https://webassembly.org/roadmap/

  13. Apple Newsroom — “iPhone X — Say hello to the future” (November 3, 2017)

    https://www.apple.com/newsroom/2017/11/iphone-x-arriving-in-stores-around-the-world/

  14. Alibaba Group — Singles’ Day 2017 results: $25.3B in 24 hours

    https://www.alibabagroup.com/en-US/news/3360

  15. CNCF YouTube — KubeCon + CloudNativeCon North America 2017 session recordings

    https://www.youtube.com/playlist?list=PLj6h78yzYM2P-3-xqvmWaZbbI1sW-ulZb

  16. CNCF DevStats — Kubernetes project velocity and contributor metrics

    https://web.archive.org/web/20171204231935/https://devstats.k8s.io/

  17. Kelsey Hightower — kubernetes-the-hard-way GitHub repository

    https://github.com/kelseyhightower/kubernetes-the-hard-way

  18. PyTorch GitHub — Release notes for PyTorch 0.3 (December 2017)

    https://github.com/pytorch/pytorch/releases/tag/v0.3.0

  19. Serverless Framework GitHub — Release history v1.26 and Q4 2017 releases

    https://github.com/serverless/serverless/releases

  20. CNCF Survey 2017 — “Cloud Native Technologies: Scaling Production Applications” (December 6, 2017)

    https://www.cncf.io/blog/2017/12/06/cloud-native-technologies-scaling-production-applications

  21. ThoughtWorks Technology Radar — November 2017 edition (service mesh in “Assess”)

    https://www.thoughtworks.com/radar

  22. Kubernetes Blog — “Request Routing and Policy Management with the Istio Service Mesh” (October 2017)

    https://kubernetes.io/blog/2017/10/request-routing-and-policy-management/

  23. AWS Blog — “New Amazon EC2 Instances with up to 8 NVIDIA Tesla V100 GPUs (P3)” (October 2017)

    https://aws.amazon.com/blogs/aws/new-amazon-ec2-instances-with-up-to-8-nvidia-tesla-v100-gpus-p3/

Free ebook

Free AI Video, Generated Locally

Run Wan 2.1 in ComfyUI on your own GPU — the scripts I use, measured times, sample clips. No cloud, no API keys.

No spam. Unsubscribe at any time.

Artur Poniedziałek
Artur Poniedziałek
IT Expert & Project Manager
🤖 AI ⚡ PM 🐍 Python 🖥️ Local AI

IT Expert & Project Manager with 15+ years of experience. Exploring practical AI applications — from local LLMs and RAG systems to workflow automation. Writing to share knowledge and inspire others to experiment with new technologies.

Leave a Reply

Your email address will not be published. Required fields are marked *