We now have Minio up and running, it’s time to configure Cribl Edge to collect some data. First, sign up for a Cribl.Cloud account. It’s free for up to 1TB/Day and 10 search executors. Signing up should be pretty straightforward so I’ll not document it here. I sign up with my Google ID, as it’s the simplest way to authenticate for me. Note, you can also run the Cribl leader yourself if you like, also free up to 10TB a day, but you won’t have access to Search as it is Cloud only.

Next, we need to get Minio exposed to the Internet so that Cribl’s search workers, running in AWS Lambda, can access the S3 compatible API exposed by Minio. In my last post, I mentioned Tailscale as a way to bridge the Internet to my Kubernetes cluster. Now, they’ve provided a new alpha level feature which makes it even easier, Tailscale Funnels. Tailscale provides several advantages for my home setup: Universal reachability, like my laptop is on the LAN from anywhere Central DNS for all nodes Central SSH key management for all nodes Tunneling from the Internet, including managing TLS certicates automatically If you haven’t setup Tailscale at all, check out the Quickstart.

Now that Minio is internet accessible, let’s configure Cribl Search to read that data. In Search, there’s two concepts that are relevant to our configuration: Datasets and Dataset Providers. We will configure a Dataset Provider to access our Minio endpoint on the internet, and a Dataset to query our particular bucket in Minio. Go to Cribl Search From Edge or Search, select the product hamburger at the top and select Search From the Cloud main navigation, click Search Click Data Click Dataset Providers at the left Click the New Dataset Provider button Under Dataset Provider Type, click Cribl Edge then select Amazon S3 Click Advanced Settings to expand more options Fill out the form like this: Add an ID Set Access Key and Secret Key to values you setup in Part 1 Set Endpoint to the https:// URL you got in Part 3 Click Save You now have a Dataset Provider which is pointing to your Minio.

Hello World First post in this blog. Will probably be removed.