Python SDK
The Python SDK, a PyO3 wrapper around the Rust SDK, and how to install it.
The Iggy Python SDK is a client library that allows you to interact with the Iggy API from your Python application. It is built as a PyO3 wrapper around the Rust SDK, which means it supports TCP, QUIC, HTTP, and WebSocket transports via connection strings. The package is available on PyPI and the source code can be found on GitHub.
Because the wheel bundles the Rust SDK, it speaks only the current Iggy wire protocol and doesn't fall back to older formats. Keep the client and server versions in step: pair the newest wheel with the newest server.
Installation
pip install apache-iggyQuick start
The samples below expect an Iggy server on 127.0.0.1:8090:
# Latest release
docker run --rm \
--cap-add=SYS_NICE --security-opt seccomp=unconfined --ulimit memlock=-1:-1 \
-p 8090:8090 \
-e IGGY_TCP_ADDRESS=0.0.0.0:8090 \
-e IGGY_NODE_ADVERTISED_ADDRESS=localhost \
-e IGGY_ROOT_USERNAME=iggy -e IGGY_ROOT_PASSWORD=iggy \
apache/iggy:latest
# Or from the repository source
cargo run --bin iggy-server -- --fresh --with-default-root-credentialsThe environment variables make the server reachable through the published port (it binds to 127.0.0.1 inside the container by default) and set the iggy/iggy root credentials the samples' connection string uses. Without --with-default-root-credentials (or the IGGY_ROOT_USERNAME / IGGY_ROOT_PASSWORD variables), a first boot generates a random root password instead.
Producer
import asyncio
from apache_iggy import IggyClient
from apache_iggy import SendMessage as Message
STREAM_NAME = "sample-stream"
TOPIC_NAME = "sample-topic"
PARTITION_ID = 0
async def main():
client = IggyClient.from_connection_string(
"iggy+tcp://iggy:iggy@127.0.0.1:8090"
)
await client.connect()
# Re-running this example is fine: only create what is missing.
if await client.get_stream(STREAM_NAME) is None:
await client.create_stream(name=STREAM_NAME)
if await client.get_topic(STREAM_NAME, TOPIC_NAME) is None:
await client.create_topic(
stream=STREAM_NAME,
name=TOPIC_NAME,
partitions_count=1,
)
messages = [Message(f"message-{i}") for i in range(10)]
await client.send_messages(
stream=STREAM_NAME,
topic=TOPIC_NAME,
partitioning=PARTITION_ID,
messages=messages,
)
print(f"Sent {len(messages)} message(s)")
asyncio.run(main())Consumer
import asyncio
from apache_iggy import IggyClient, PollingStrategy
STREAM_NAME = "sample-stream"
TOPIC_NAME = "sample-topic"
PARTITION_ID = 0
async def main():
client = IggyClient.from_connection_string(
"iggy+tcp://iggy:iggy@127.0.0.1:8090"
)
await client.connect()
# Next() with auto_commit=True continues from this consumer's last committed
# offset, so each run picks up where the previous one finished.
polled_messages = await client.poll_messages(
stream=STREAM_NAME,
topic=TOPIC_NAME,
partition_id=PARTITION_ID,
polling_strategy=PollingStrategy.Next(),
count=10,
auto_commit=True,
)
for message in polled_messages:
payload = message.payload().decode("utf-8")
print(f"Offset: {message.offset()}, Payload: {payload}")
asyncio.run(main())Beyond the basics
- TLS: construct the client from a
TcpConfiginstead of a connection string and settls_enabledplustls_ca_file. The getting-started example shows the full setup. - Consumer groups:
client.consumer_group(...)returns anIggyConsumerthat creates and joins the group by default and commits offsets according to the configuredAutoCommitmode. - User headers:
SendMessage(data, user_headers=...)accepts a plaindictwithstr,bytes,bool,int, orfloatvalues.HeaderKey/HeaderValuegive explicit control over the wire type. See the message-headers examples. - Topic options:
create_topic(..., options=...)accepts extra option keys as adict[str, str], validated against the server's catalog.client.describe_options("topic")lists the keys a server accepts. - Administration: user and permission management. Personal access tokens can be used for login via
AutoLogin.personal_access_token(...)in the connection config. PAT management isn't exposed yet.
Examples
Working examples are available in the examples/python directory. See Examples for the list and how to run them.