https://github.com/uken/fluent-plugin-elasticsearch
https://github.com/uken/fluent-plugin-elasticsearch
Keywords from Contributors
fluentd cncf data-collector fluentd-plugin activerecord msgpack ruby-gem marshalling rack rubygems
Last synced: about 9 hours ago
JSON representation
Repository metadata
- Host: GitHub
- URL: https://github.com/uken/fluent-plugin-elasticsearch
- Owner: uken
- License: apache-2.0
- Created: 2013-02-12T17:24:48.000Z (almost 13 years ago)
- Default Branch: master
- Last Pushed: 2025-11-24T07:02:37.000Z (26 days ago)
- Last Synced: 2025-12-09T20:47:36.236Z (10 days ago)
- Language: Ruby
- Homepage:
- Size: 1.68 MB
- Stars: 897
- Watchers: 79
- Forks: 307
- Open Issues: 103
- Releases: 0
-
Metadata Files:
- Readme: README.ElasticsearchGenID.md
- Changelog: History.md
- Contributing: CONTRIBUTING.md
- License: LICENSE.txt
README.ElasticsearchGenID.md
Index
Usage
In your Fluentd configuration, use @type elasticsearch_genid. Additional configuration is optional, default values would look like this:
<filter>
@type elasticsearch_genid
hash_id_key _hash
include_tag_in_seed false
include_time_in_seed false
use_record_as_seed false
use_entire_record false
record_keys []
separator _
hash_type sha1
</filter>
Configuration
hash_id_key
hash_id_key _id
You can specify generated hash storing key.
include_tag_in_seed
include_tag_in_seed true
You can specify to use tag for hash generation seed.
include_time_in_seed
include_time_in_seed true
You can specify to use time for hash generation seed.
use_record_as_seed
use_record_as_seed true
You can specify to use record in events for hash generation seed. This parameter should be used with record_keys parameter in practice.
record_keys
record_keys request_id,pipeline_id
You can specify keys which are record in events for hash generation seed. This parameter should be used with use_record_as_seed parameter in practice.
use_entire_record
use_entire_record true
You can specify to use entire record in events for hash generation seed.
separator
separator |
You can specify separator charactor to creating seed for hash generation.
hash_type
hash_type sha1
You can specify hash algorithm. Support algorithms md5, sha1, sha256, sha512. Default: sha1
Advanced Usage
Elasticsearch GenID plugin can handle record contents differing with the following parameters:
<filter the.awesome.your.routing.tag>
@type elasticsearch_genid
use_entire_record true
hash_type sha1
hash_id_key _hash
separator _
inc_time_as_key true
inc_tag_as_key true
</filter>
The above configuration can handle tag, time, and record differing and generate different base64 encoded hash per record.
Owner metadata
- Name: Uken Games
- Login: uken
- Email:
- Kind: organization
- Description:
- Website: www.uken.com
- Location: Toronto, Canada
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/14368?v=4
- Repositories: 60
- Last ynced at: 2023-03-24T14:09:00.412Z
- Profile URL: https://github.com/uken
GitHub Events
Total
- Issues event: 14
- Watch event: 17
- Delete event: 4
- Issue comment event: 118
- Push event: 11
- Pull request review comment event: 5
- Pull request review event: 16
- Pull request event: 23
- Fork event: 3
- Create event: 8
Last Year
- Issues event: 14
- Watch event: 11
- Delete event: 4
- Issue comment event: 116
- Push event: 11
- Pull request review comment event: 5
- Pull request review event: 16
- Pull request event: 23
- Fork event: 3
- Create event: 8
Committers metadata
Last synced: 2 days ago
Total Commits: 970
Total Committers: 117
Avg Commits per committer: 8.291
Development Distribution Score (DDS): 0.444
Commits in past year: 13
Committers in past year: 6
Avg Commits per committer in past year: 2.167
Development Distribution Score (DDS) in past year: 0.692
| Name | Commits | |
|---|---|---|
| Hiroshi Hatake | c****c@g****m | 539 |
| ☃ pitr | p****n@g****m | 78 |
| Masahiro Nakagawa | r****y@g****m | 22 |
| Kentaro Hayashi | h****i@c****m | 19 |
| Kumaravel Arunachalam | k****4@g****m | 17 |
| Kentaro Tokutomi | k****i@g****m | 17 |
| ☃ pitr | p****v@z****m | 17 |
| Diogo Terror | me@d****m | 11 |
| ewolinetz | e****t@r****m | 9 |
| 임정택 | k****n@d****m | 8 |
| Filip Pytloun | f****p@p****z | 8 |
| Yissachar Radcliffe | y****e@c****m | 8 |
| Dobes Vandermeer | d****v@g****m | 7 |
| Samuli Silvius | s****s@n****m | 7 |
| Kumaravel | k****m@k****m | 7 |
| Martins Sipenko | m****o@g****m | 6 |
| se-m | s****m@g****m | 6 |
| Fujimoto Seiji | f****o@c****m | 5 |
| EthanLiou | e****u@g****m | 5 |
| Jungtaek Lim | k****n@g****m | 5 |
| Matteias Collet | m****t@b****h | 5 |
| Matthew O'Riordan | m****n@g****m | 5 |
| Robert Firek | r****k@g****m | 5 |
| Gihad Murad | g****d@g****m | 5 |
| meetyg | a****i@g****m | 4 |
| ialidzhikov | i****v@g****m | 4 |
| dependabot[bot] | 4****] | 4 |
| Ash Berlin | a****b@f****m | 4 |
| Christian Hernvall | c****l@s****e | 4 |
| Denis Filippov | d****v@o****m | 4 |
| and 87 more... | ||
Committer domains:
- clear-code.com: 7
- redhat.com: 3
- leadformance.com: 2
- mayadata.io: 1
- farmersedge.ca: 1
- bracket.co.jp: 1
- itlab.cz: 1
- goodgamestudios.com: 1
- live.de: 1
- justdice.io: 1
- danielschaaff.com: 1
- tuenti.com: 1
- hatena.ne.jp: 1
- me.com: 1
- reevoo.com: 1
- mia-platform.eu: 1
- oneincsystems.com: 1
- svt.se: 1
- firemirror.com: 1
- bluewin.ch: 1
- gogolook.com: 1
- klm.com: 1
- nokia.com: 1
- caseware.com: 1
- pytloun.cz: 1
- daumcorp.com: 1
- diogoterror.com: 1
- slaunay.fr: 1
- usabilla.com: 1
- ionos.com: 1
- raytung.net: 1
- cookpad.com: 1
- sdrbrg.se: 1
- jamf.com: 1
- hostinger.com: 1
- fcg.fyi: 1
- accipiterradar.com: 1
- godaddy.com: 1
- gruszka.info: 1
- haines.org.nz: 1
- ktamura.com: 1
- grusy.de: 1
- bolt.me: 1
- coreos.com: 1
- pindropsecurity.com: 1
- adobe.com: 1
- rms.com: 1
- be-mobile.com: 1
- 163.com: 1
- thebackplane.com: 1
- six-group.com: 1
- opsunit.com: 1
- coralbay.tv: 1
- zynga.com: 1
Issue and Pull Request metadata
Last synced: 5 days ago
Total issues: 117
Total pull requests: 62
Average time to close issues: about 1 month
Average time to close pull requests: 9 days
Total issue authors: 105
Total pull request authors: 24
Average comments per issue: 4.65
Average comments per pull request: 1.19
Merged pull request: 52
Bot issues: 0
Bot pull requests: 4
Past year issues: 11
Past year pull requests: 22
Past year average time to close issues: about 15 hours
Past year average time to close pull requests: 3 days
Past year issue authors: 9
Past year pull request authors: 7
Past year average comments per issue: 6.0
Past year average comments per pull request: 1.32
Past year merged pull request: 17
Past year bot issues: 0
Past year bot pull requests: 1
Top Issue Authors
- andrew-pickin-epi (5)
- Sameer0998 (3)
- shdluan (2)
- loGit123 (2)
- danfinn (2)
- harish2497 (2)
- jiachinzhao (2)
- OranShuster (2)
- huanggze (1)
- snemetz (1)
- megatr0n28 (1)
- pstray (1)
- anand3493 (1)
- jkulak (1)
- aalemanq (1)
Top Pull Request Authors
- cosmo0920 (21)
- kenhys (6)
- sparrowt (4)
- dependabot[bot] (4)
- daipom (3)
- Watson1978 (2)
- joseacl (2)
- kvokka (2)
- yugeeklab (2)
- naveensrinivasan (2)
- ashie (1)
- raytung (1)
- Clee2691 (1)
- josevromo (1)
- sihyeonn (1)
Top Issue Labels
- question (9)
- help wanted (6)
- waiting-on-feedback (6)
- feature-request (4)
- kubernetes (4)
- Future work (1)
- incomplete (1)
- v1.0 (1)
- GCP (1)
- Elasticsearch Server Issue (1)
- Ruby Core Issue (1)
- wontfix (1)
- level:Hard (1)
Top Pull Request Labels
- dependency conflict (3)
- github_actions (2)
- dependencies (1)
Package metadata
- Total packages: 4
-
Total downloads:
- rubygems: 168,855,931 total
- Total docker downloads: 262,226,398
- Total dependent packages: 6 (may contain duplicates)
- Total dependent repositories: 1,336 (may contain duplicates)
- Total versions: 394
- Total maintainers: 7
gem.coop: fluent-plugin-elasticsearch
Elasticsearch output plugin for Fluent event collector
- Homepage: https://github.com/uken/fluent-plugin-elasticsearch
- Documentation: http://www.rubydoc.info/gems/fluent-plugin-elasticsearch/
- Licenses: Apache-2.0
- Latest release: 6.0.0 (published 7 months ago)
- Last Synced: 2025-12-18T09:25:10.976Z (1 day ago)
- Versions: 196
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 84,432,604 Total
- Docker Downloads: 131,113,199
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 0.203%
- Downloads: 0.31%
- Docker downloads count: 0.501%
- Maintainers (5)
rubygems.org: fluent-plugin-elasticsearch
Elasticsearch output plugin for Fluent event collector
- Homepage: https://github.com/uken/fluent-plugin-elasticsearch
- Documentation: http://www.rubydoc.info/gems/fluent-plugin-elasticsearch/
- Licenses: Apache-2.0
- Latest release: 6.0.0 (published 7 months ago)
- Last Synced: 2025-12-17T22:01:46.543Z (2 days ago)
- Versions: 196
- Dependent Packages: 6
- Dependent Repositories: 1,336
- Downloads: 84,417,877 Total
- Docker Downloads: 131,113,199
-
Rankings:
- Downloads: 0.282%
- Docker downloads count: 0.611%
- Dependent repos count: 0.855%
- Average: 1.292%
- Forks count: 1.529%
- Stargazers count: 1.993%
- Dependent packages count: 2.484%
- Maintainers (5)
gem.coop: fluent-plugin-elasticsearch-dext
Elasticsearch output plugin for Fluent event collector with small modification from Dext
- Homepage: https://github.com/wbrefvem/fluent-plugin-elasticsearch
- Documentation: http://www.rubydoc.info/gems/fluent-plugin-elasticsearch-dext/
- Licenses: Apache-2.0
- Latest release: 5.0.2 (published almost 5 years ago)
- Last Synced: 2025-12-16T11:11:23.974Z (3 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 2,725 Total
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 29.706%
- Downloads: 89.118%
- Maintainers (2)
rubygems.org: fluent-plugin-elasticsearch-dext
Elasticsearch output plugin for Fluent event collector with small modification from Dext
- Homepage: https://github.com/wbrefvem/fluent-plugin-elasticsearch
- Documentation: http://www.rubydoc.info/gems/fluent-plugin-elasticsearch-dext/
- Licenses: Apache-2.0
- Latest release: 5.0.2 (published almost 5 years ago)
- Last Synced: 2025-12-16T11:11:23.908Z (3 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 2,725 Total
-
Rankings:
- Dependent packages count: 15.706%
- Forks count: 29.778%
- Stargazers count: 43.019%
- Average: 45.332%
- Dependent repos count: 46.782%
- Downloads: 91.377%
- Maintainers (2)
Dependencies
- coveralls >= 0.8.0
- oj >= 0
- simplecov >= 0
- flexmock ~> 2.0 development
- minitest ~> 5.8 development
- rake >= 0 development
- test-unit ~> 3.3.0 development
- webmock ~> 3 development
- webrick ~> 1.7.0 development
- elasticsearch >= 0
- excon >= 0
- fluentd >= 0.14.22
- roots/issue-closer-action v1.1 composite
- actions/checkout v3 composite
- ruby/setup-ruby v1 composite
- actions/checkout v3 composite
- ruby/setup-ruby v1 composite
- actions/checkout v3 composite
- ruby/setup-ruby v1 composite
Score: 31.551743132804503