Datavolo's blog

What's in Datavolo's blog? Insights and inspiration, case studies and community for AI/ML and Data Engineers. Discover what we are talking about everyday here at Datavolo!

Apache NiFi – designed for extension at scale

Apache NiFi – designed for extension at scale

AI systems need data all along the spectrum of unstructured, structured, and multi-modal.  The protocols by which these diverse types of data are both acquired and delivered are as varied as the data types themselves.  At the same time data volumes and latency requirements grow ever stronger which demands solutions which scale down and up first – then out.  In other words we need maximum efficiency, we can’t resort to remote procedure calls for every operation, and we need to support hundreds if not thousands of different components or tools in the same virtual machine.

Collecting Logs with Apache NiFi and OpenTelemetry

Collecting Logs with Apache NiFi and OpenTelemetry

Introduction OpenTelemetry has become a unifying force for software observability, providing a common vocabulary for describing logs, metrics, and traces. With interfaces and instrumentation capabilities in multiple programming languages, OTel presents a compelling...