https://github.com/brianmario/charlock_holmes

Character encoding detection, brought to you by ICU
https://github.com/brianmario/charlock_holmes

Keywords from Contributors

rubygems activerecord mvc activejob rack minitest crash-reporting ruby-gem background-jobs sinatra

Last synced: about 21 hours ago
JSON representation

Repository metadata

Character encoding detection, brought to you by ICU

• Host: GitHub
• URL: https://github.com/brianmario/charlock_holmes
• Owner: brianmario
• License: mit
• Created: 2011-08-23T22:53:03.000Z (over 14 years ago)
• Default Branch: master
• Last Pushed: 2024-07-11T04:26:42.000Z (over 1 year ago)
• Last Synced: 2025-12-11T16:21:59.623Z (1 day ago)
• Language: Ruby
• Homepage:
• Size: 81.3 MB
• Stars: 1,065
• Watchers: 21
• Forks: 150
• Open Issues: 68
• Releases: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

README.md

require 'charlock_holmes'

contents = File.read('test.xml')
detection = CharlockHolmes::EncodingDetector.detect(contents)
# => {:encoding => 'UTF-8', :confidence => 100, :type => :text}

# optionally there will be a :language key as well, but
# that's mostly only returned for legacy encodings like ISO-8859-1

detector = CharlockHolmes::EncodingDetector.new

detection1 = detector.detect(File.read('test.xml'))
detection2 = detector.detect(File.read('test2.json'))

# and so on...

require 'charlock_holmes/string'

contents = File.read('test.xml')

detection = contents.detect_encoding

require 'charlock_holmes/string'

contents = File.read('test.xml')

# this will detect and set the encoding of `contents`, then return self
contents.detect_encoding!

content = File.read('test2.txt')
detection = CharlockHolmes::EncodingDetector.detect(content)
utf8_encoded_content = CharlockHolmes::Converter.convert content, detection[:encoding], 'UTF-8'

bundle config build.charlock_holmes --with-icu-dir=/path/to/installed/icu4c

gem install charlock_holmes -- --with-icu-dir=/path/to/installed/icu4c

bundle config build.charlock_holmes --with-icu-dir=/path/to/installed/icu4c --with-cxxflags=-std=c++11

gem install charlock_holmes -- --with-icu-dir=/path/to/installed/icu4c --with-cxxflags=-std=c++11

brew install icu4c

bundle config build.charlock_holmes --with-icu-dir=/usr/local/opt/icu4c

gem install charlock_holmes -- --with-icu-dir=/usr/local/opt/icu4c

Owner metadata

• Name: Brian Lopez
• Login: brianmario
• Email:
• Kind: user
• Description:
• Website: https://twitter.com/brianmario
• Location: Paso Robles, CA
• Twitter: brianmario
• Company: Lopai Cellars
• Icon url: https://avatars.githubusercontent.com/u/11571?u=a1ff7b554784caa8e18118531eabd8650ddf050a&v=4
• Repositories: 38
• Last ynced at: 2025-10-11T20:47:34.713Z
• Profile URL: https://github.com/brianmario

GitHub Events

Total

• Issues event: 3
• Watch event: 28
• Issue comment event: 28
• Pull request review comment event: 2
• Pull request review event: 4
• Pull request event: 4
• Fork event: 11

Last Year

• Issues event: 2
• Watch event: 22
• Issue comment event: 19
• Pull request review comment event: 2
• Pull request review event: 4
• Pull request event: 3
• Fork event: 9

Committers metadata

Last synced: 7 days ago

Committer domains:

• github.com: 3
• nleger.com: 1
• renuo.ch: 1
• poltyn.com: 1
• yandex.ru: 1
• gerf.org: 1
• spotify.com: 1
• grosser.it: 1
• joshpeek.com: 1
• ktdreyer.com: 1
• tmm1.net: 1
• ruby-lang.org: 1

Issue and Pull Request metadata

Last synced: 7 days ago

Package metadata

• Total packages: 23
• Total downloads:
  • rubygems: 125,348,649 total
• Total docker downloads: 2,862,029,824
• Total dependent packages: 60 (may contain duplicates)
• Total dependent repositories: 3,719 (may contain duplicates)
• Total versions: 83
• Total maintainers: 6

Dependencies

Score: 32.06916364401828