Skip to content

feat(function): expose input_specs for per-topic consumer config #219

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
freeznet merged 4 commits into from
Aug 26, 2026
Merged

feat(function): expose input_specs for per-topic consumer config #219

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
0538adb
feat(function): expose input_specs for per-topic consumer config
david-streamlio Aug 20, 2026
3460f16
Fix function input specs round trips
freeznet Aug 20, 2026
f0798ab
Merge branch 'master' into feat/function-input-specs
freeznet Aug 26, 2026
dfab825
Update pulsar client dependency
freeznet Aug 26, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 19 additions & 0 deletions docs/resources/function.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,7 @@ Manages Pulsar Functions through the Functions Worker API.
- `disk_mb` (Number) The disk that need to be allocated per function instance
- `forward_source_message_property` (Boolean) Whether to forward source message property to the function output message.
- `go` (String) The path to the go file.
- `input_specs` (Block Set) Per-topic consumer configuration for the function's input topics, such as the receiver queue size. A topic configured here does not need to be repeated in `inputs`; if it is, this block takes precedence. (see [below for nested schema](#nestedblock--input_specs))
- `input_type_classname` (String) The input type class name of the function.
- `inputs` (Set of String) The input topics of the function.
- `jar` (String) The path to the jar file.
Expand Down Expand Up @@ -62,6 +63,24 @@ Manages Pulsar Functions through the Functions Worker API.

- `id` (String) The ID of this resource.

<a id="nestedblock--input_specs"></a>
### Nested Schema for `input_specs`

Required:

- `key` (String) The input topic that this consumer configuration applies to.

Optional:

- `consumer_properties` (Map of String) Consumer properties key/values for this topic.
- `is_regex_pattern` (Boolean) Whether the topic is a regex pattern matching multiple topics. Cannot be changed in place; changing it replaces the function.
- `pool_messages` (Boolean) Whether the consumer pools messages for this topic.
- `receiver_queue_size` (Number) The consumer receiver queue size for this topic. Pulsar defaults to 1000 when unset, which buffers up to that many messages per function instance.
- `schema_properties` (Map of String) Schema properties key/values for this topic.
- `schema_type` (String) The schema type of this topic, either a builtin schema type such as `avro` or a Schema implementation class name.
- `serde_class_name` (String) The serde class name of this topic. Ignored by Pulsar when `schema_type` is also set.


<a id="nestedblock--sink_config"></a>
### Nested Schema for `sink_config`

Expand Down
Loading
Loading