Note - this is an outdated example, please see https://cloud.google.com/solutions/real-time/fluentd-bigquery for links to the updated technical content.
This sample launches a Docker container that's preconfigured with nginx and Fluentd and uses a Fluentd-to-Bigquery plugin to load web server access logs into Google BigQuery in near-real-time.
For a step-by-step tutorial, see: https://cloud.google.com/solutions/real-time/fluentd-bigquery, which walks you through the following steps:
- Run an nginx web server in a Google Compute Engine instance.
- Log browser traffic to that server using Fluentd.
- Query the logged data using the BigQuery Browser Tool and using Google Apps Script from a Google Spreadsheet.
- Visualize the query results in a chart within a Google Spreadsheet that automatically refreshes.
- See LICENSE