SnowPro Advanced Data Engineer

By Snowflake · Question Mode

QuestionQ84

VerifiedIngest and Process Data

When loading data with the Snowflake Connector for Kafka, the Kafka log file included the following information:

org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member

Which combination of tasks should be used to resolve this issue?

Choose two
Explanation

This exception occurs when message processing takes longer than the configured maximum interval between consumer poll() calls, so Kafka rebalances the consumer group before offsets can be committed. Reducing the number of records processed per operation to 50 shortens batch processing, while increasing the execution timeout to 900000 ms allows more time between polls.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!