https://github.com/uken/fluent-plugin-elasticsearch

Keywords from Contributors

fluentd cncf data-collector fluentd-plugin activerecord msgpack ruby-gem rack rubygems marshaller

Last synced: about 22 hours ago
JSON representation

Repository metadata

Host: GitHub
URL: https://github.com/uken/fluent-plugin-elasticsearch
Owner: uken
License: apache-2.0
Created: 2013-02-12T17:24:48.000Z (over 13 years ago)
Default Branch: master
Last Pushed: 2026-09-16T09:45:52.000Z (9 days ago)
Last Synced: 2026-09-22T03:12:03.579Z (3 days ago)
Language: Ruby
Homepage:
Size: 1.71 MB
Stars: 897
Watchers: 79
Forks: 308
Open Issues: 104
Releases: 0
Metadata Files:
- Readme: README.ElasticsearchGenID.md
- Changelog: History.md
- Contributing: CONTRIBUTING.md
- License: LICENSE.txt

Usage

In your Fluentd configuration, use @type elasticsearch_genid. Additional configuration is optional, default values would look like this:

<filter>
  @type elasticsearch_genid
  hash_id_key _hash
  include_tag_in_seed false
  include_time_in_seed false
  use_record_as_seed false
  use_entire_record false
  record_keys []
  separator _
  hash_type sha1
</filter>

Configuration

hash_id_key

hash_id_key _id

You can specify generated hash storing key.

include_tag_in_seed

include_tag_in_seed true

You can specify to use tag for hash generation seed.

include_time_in_seed

include_time_in_seed true

You can specify to use time for hash generation seed.

use_record_as_seed

use_record_as_seed true

You can specify to use record in events for hash generation seed. This parameter should be used with record_keys parameter in practice.

record_keys

record_keys request_id,pipeline_id

You can specify keys which are record in events for hash generation seed. This parameter should be used with use_record_as_seed parameter in practice.

use_entire_record

use_entire_record true

You can specify to use entire record in events for hash generation seed.

separator

separator |

You can specify separator charactor to creating seed for hash generation.

hash_type

hash_type sha1

You can specify hash algorithm. Support algorithms md5, sha1, sha256, sha512. Default: sha1

Advanced Usage

Elasticsearch GenID plugin can handle record contents differing with the following parameters:

<filter the.awesome.your.routing.tag>
  @type elasticsearch_genid
  use_entire_record true
  hash_type sha1
  hash_id_key _hash
  separator _
  inc_time_as_key true
  inc_tag_as_key true
</filter>

The above configuration can handle tag, time, and record differing and generate different base64 encoded hash per record.

Owner metadata

Name: Uken Games
Login: uken
Email:
Kind: organization
Description:
Website: www.uken.com
Location: Toronto, Canada
Twitter:
Company:
Icon url: https://avatars.githubusercontent.com/u/14368?v=4
Repositories: 60
Last ynced at: 2023-03-24T14:09:00.412Z
Profile URL: https://github.com/uken

GitHub Events

Total

Create event: 8
Delete event: 5
Fork event: 3
Issue comment event: 119
Issues event: 14
Pull request event: 24
Pull request review comment event: 5
Pull request review event: 16
Push event: 13
Watch event: 17

Last Year

Create event: 1
Delete event: 1
Issue comment event: 2
Issues event: 1
Pull request event: 2
Push event: 2

Committers metadata

Last synced: 3 days ago

Total Commits: 978
Total Committers: 118
Avg Commits per committer: 8.288
Development Distribution Score (DDS): 0.449

Commits in past year: 8
Committers in past year: 4
Avg Commits per committer in past year: 2.0
Development Distribution Score (DDS) in past year: 0.625

Name	Email	Commits
Hiroshi Hatake	c**c@g**m	539
☃ pitr	p**n@g**m	78
Masahiro Nakagawa	r**y@g**m	22
Kentaro Hayashi	h**i@c**m	20
Kumaravel Arunachalam	k**4@g**m	17
Kentaro Tokutomi	k**i@g**m	17
☃ pitr	p**v@z**m	17
Diogo Terror	me@d****m	11
ewolinetz	e**t@r**m	9
임정택	k**n@d**m	8
Filip Pytloun	f**p@p**z	8
Yissachar Radcliffe	y**e@c**m	8
Samuli Silvius	s**s@n**m	7
Kumaravel	k**m@k**m	7
Dobes Vandermeer	d**v@g**m	7
Martins Sipenko	m**o@g**m	6
dependabot[bot]	4****]	6
se-m	s**m@g**m	6
Fujimoto Seiji	f**o@c**m	5
EthanLiou	e**u@g**m	5
Jungtaek Lim	k**n@g**m	5
Matteias Collet	m**t@b**h	5
Matthew O'Riordan	m**n@g**m	5
Robert Firek	r**k@g**m	5
Gihad Murad	g**d@g**m	5
meetyg	a**i@g**m	4
ialidzhikov	i**v@g**m	4
Ash Berlin	a**b@f**m	4
Christian Hernvall	c**l@s**e	4
Denis Filippov	d**v@o**m	4
and 88 more...

Committer domains:

Issue and Pull Request metadata

Last synced: 2 days ago

Total issues: 630
Total pull requests: 463
Average time to close issues: 2 months
Average time to close pull requests: 12 days
Total issue authors: 486
Total pull request authors: 144
Average comments per issue: 4.8
Average comments per pull request: 2.03
Merged pull request: 400
Bot issues: 0
Bot pull requests: 7

Past year issues: 6
Past year pull requests: 6
Past year average time to close issues: 2 days
Past year average time to close pull requests: 2 months
Past year issue authors: 5
Past year pull request authors: 4
Past year average comments per issue: 1.0
Past year average comments per pull request: 0.67
Past year merged pull request: 6
Past year bot issues: 0
Past year bot pull requests: 2

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/uken/fluent-plugin-elasticsearch

Top Issue Authors

ghost (10)
cosmo0920 (8)
chikinchoi (8)
chenjienn (8)
dmnfortytwo (6)
andrew-pickin-epi (6)
like-inspur (5)
tirelibirefe (4)
jcantrill (4)
jain108shubhamtbt (4)
jeesim2 (3)
liuchintao (3)
g3kr (3)
dobesv (3)
himanshigpta (3)

Top Pull Request Authors

cosmo0920 (209)
kenhys (12)
kenrota (10)
jcantrill (9)
richm (7)
dependabot[bot] (7)
dobesv (6)
daipom (6)
repeatedly (5)
kumaravel29 (5)
photom (4)
ialidzhikov (4)
fpytloun (4)
Watson1978 (4)
sparrowt (4)

Top Issue Labels

waiting-on-feedback (79)
question (57)
feature-request (48)
help wanted (23)
kubernetes (17)
bug (16)
incomplete (14)
level:Normal (13)
elasticsearch-ruby issue (10)
wontfix (10)
Future work (9)
level:Easy (9)
level:Hard (8)
waiting-for-reproducible-steps (7)
plugin limitation (6)
v1.0 (5)
v0.12 (4)
Priority: Low (3)
Ruby Core Issue (3)
v0.14 (2)
outdated usage (2)
invalid (2)
GCP (2)
Fluentd core issue (2)
documentation (2)
searchguard (1)
bug-for-v0.14 (1)
dependency conflict (1)
Elasticsearch Server Issue (1)
using-v0.14-api (1)

Top Pull Request Labels

uplift-needed (9)
waiting-on-feedback (7)
v0.12 (7)
backport-needed (5)
github_actions (5)
dependencies (4)
dependency conflict (3)
v1.0 (3)
v0.14 (3)

Package metadata

Total packages: 5
Total downloads:
- rubygems: 187,903,462 total
Total docker downloads: 262,226,398
Total dependent packages: 6 (may contain duplicates)
Total dependent repositories: 1,336 (may contain duplicates)
Total versions: 578
Total maintainers: 7

gem.coop: fluent-plugin-elasticsearch

Elasticsearch output plugin for Fluent event collector

Homepage: https://github.com/uken/fluent-plugin-elasticsearch
Documentation: http://www.rubydoc.info/gems/fluent-plugin-elasticsearch/
Licenses: Apache-2.0
Latest release: 6.0.0 (published over 1 year ago)
Last Synced: 2026-09-23T03:35:09.622Z (2 days ago)
Versions: 196
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 93,948,857 Total
Docker Downloads: 131,113,199
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 0.203%
- Downloads: 0.31%
- Docker downloads count: 0.501%
Maintainers (5)
- kenhys
- pitr
- cosmo0920
- dterror
- gihad

rubygems.org: fluent-plugin-elasticsearch