Xedge>> logstash-gelf>> 返回
项目作者： mp911de

项目描述 ：
Graylog Extended Log Format (GELF) implementation in Java for all major logging frameworks: log4j, log4j2, java.util.logging, logback, JBossAS7 and WildFly 8-12
高级语言： Java
项目地址: git://github.com/mp911de/logstash-gelf.git
创建时间： 2013-09-26T12:57:31Z
项目社区：https://github.com/mp911de/logstash-gelf
开源协议：MIT License
下载


logstash-gelf

This project is now archived, after a decade of maintenance, with 36 releases and several occasional contributors. The project is feature complete, and we see little issue traffic. With me being the sole maintainer, it is about time to turn off the lights here and move on to free up time for other duties. K, thx, good bye.

Join the chat at https://gitter.im/mp911de/logstash-gelf

Maven Central

Provides logging to logstash using the Graylog Extended Logging Format (GELF 1.0 and 1.1) for using with:

logstash-gelf requires as of version 1.14.0 Java 7 or higher. Version 1.13.x and older require Java 6.
See also http://logging.paluch.biz/ or http://www.graylog2.org/resources/gelf/specification for further documentation.

Including it in your project

Maven:

  1. <dependency>
  2.     <groupId>biz.paluch.logging</groupId>
  3.     <artifactId>logstash-gelf</artifactId>
  4.     <version>x.y.z</version>
  5. </dependency>

Direct download from Maven Central

JBoss AS/WildFly Module Download:

  1. <dependency>
  2.     <groupId>biz.paluch.logging</groupId>
  3.     <artifactId>logstash-gelf</artifactId>
  4.     <version>x.y.z</version>
  5.     <classifier>logging-module</classifier>
  6. </dependency>

Direct download from Maven Central

Using snapshot builds:

  1. <dependency>
  2.     <groupId>biz.paluch.logging</groupId>
  3.     <artifactId>logstash-gelf</artifactId>
  4.     <version>x.y.z-SNAPSHOT</version>
  5. </dependency>
  7. <repositories>
  8.     <repository>
  9.         <id>sonatype-nexus-snapshots</id>
  10.         <url>https://oss.sonatype.org/content/repositories/snapshots</url>
  11.         <snapshots>
  12.             <enabled>true</enabled>
  13.         </snapshots>
  14.     </repository>
  15. </repositories>

Java Util Logging GELF configuration

Properties

  1. handlers = biz.paluch.logging.gelf.jul.GelfLogHandler, java.util.logging.ConsoleHandler
  3. .handlers = biz.paluch.logging.gelf.jul.GelfLogHandler, java.util.logging.ConsoleHandler
  4. .level = INFO
  6. biz.paluch.logging.gelf.jul.GelfLogHandler.host=udp:localhost
  7. biz.paluch.logging.gelf.jul.GelfLogHandler.port=12201
  8. biz.paluch.logging.gelf.jul.GelfLogHandler.version=1.1
  9. biz.paluch.logging.gelf.jul.GelfLogHandler.facility=java-test
  10. biz.paluch.logging.gelf.jul.GelfLogHandler.extractStackTrace=true
  11. biz.paluch.logging.gelf.jul.GelfLogHandler.filterStackTrace=true
  12. biz.paluch.logging.gelf.jul.GelfLogHandler.timestampPattern=yyyy-MM-dd HH:mm:ss,SSS
  13. biz.paluch.logging.gelf.jul.GelfLogHandler.maximumMessageSize=8192
  15. # This are static fields
  16. biz.paluch.logging.gelf.jul.GelfLogHandler.additionalFields=fieldName1=fieldValue1,fieldName2=fieldValue2
  17. # Optional: Specify field types
  18. biz.paluch.logging.gelf.jul.GelfLogHandler.additionalFieldTypes=fieldName1=String,fieldName2=Double,fieldName3=Long
  19. biz.paluch.logging.gelf.jul.GelfLogHandler.level=INFO

Glassfish/Payara configuration

Install the library with its dependencies (see download above) in Glassfish. Place it below the $GFHOME/glassfish/domains/$YOURDOMAIN/lib/ext/ path, then add the Java Util Logging to your logging.properties file.

Properties

  1. log4j.appender.gelf=biz.paluch.logging.gelf.log4j.GelfLogAppender
  2. log4j.appender.gelf.Threshold=INFO
  3. log4j.appender.gelf.Host=udp:localhost
  4. log4j.appender.gelf.Port=12201
  5. log4j.appender.gelf.Version=1.1
  6. log4j.appender.gelf.Facility=java-test
  7. log4j.appender.gelf.ExtractStackTrace=true
  8. log4j.appender.gelf.FilterStackTrace=true
  9. log4j.appender.gelf.MdcProfiling=true
  10. log4j.appender.gelf.TimestampPattern=yyyy-MM-dd HH:mm:ss,SSS
  11. log4j.appender.gelf.MaximumMessageSize=8192
  13. # This are static fields
  14. log4j.appender.gelf.AdditionalFields=fieldName1=fieldValue1,fieldName2=fieldValue2
  15. # Optional: Specify field types
  16. log4j.appender.gelf.AdditionalFieldTypes=fieldName1=String,fieldName2=Double,fieldName3=Long
  18. # This are fields using MDC
  19. log4j.appender.gelf.MdcFields=mdcField1,mdcField2
  20. log4j.appender.gelf.DynamicMdcFields=mdc.*,(mdc|MDC)fields
  21. log4j.appender.gelf.DynamicMdcFieldTypes=my_field.*=String,business\..*\.field=double
  22. log4j.appender.gelf.IncludeFullMdc=true

XML

  1. <appender name="gelf" class="biz.paluch.logging.gelf.log4j.GelfLogAppender">
  2.     <param name="Threshold" value="INFO" />
  3.     <param name="Host" value="udp:localhost" />
  4.     <param name="Port" value="12201" />
  5.     <param name="Version" value="1.1" />
  6.     <param name="Facility" value="java-test" />
  7.     <param name="ExtractStackTrace" value="true" />
  8.     <param name="FilterStackTrace" value="true" />
  9.     <param name="MdcProfiling" value="true" />
  10.     <param name="TimestampPattern" value="yyyy-MM-dd HH:mm:ss,SSS" />
  11.     <param name="MaximumMessageSize" value="8192" />
  13.     <!-- This are static fields -->
  14.     <param name="AdditionalFields" value="fieldName1=fieldValue1,fieldName2=fieldValue2" />
  15.     <!-- Optional: Specify field types -->
  16.     <param name="AdditionalFieldTypes" value="fieldName1=String,fieldName2=Double,fieldName3=Long" />
  18.     <!-- This are fields using MDC -->
  19.     <param name="MdcFields" value="mdcField1,mdcField2" />
  20.     <param name="DynamicMdcFields" value="mdc.*,(mdc|MDC)fields" />
  21.     <param name="DynamicMdcFieldTypes" value="my_field.*=String,business\..*\.field=double" />
  22.     <param name="IncludeFullMdc" value="true" />
  23. </appender>

log4j2 GELF configuration

Fields

Log4j v2 supports an extensive and flexible configuration in contrast to other log frameworks (JUL, log4j v1). This allows you to specify your needed fields you want to use in the GELF message. An empty field configuration results in a message containing only

  • timestamp
  • level (syslog level)
  • host
  • facility
  • message
  • short_message

You can add different fields:

  • Static Literals
  • MDC Fields
  • Log-Event fields (using Pattern Layout)

In order to do so, use nested Field elements below the Appender element.

Static Literals

  1. <Field name="fieldName1" literal="your literal value" ></Field>

MDC Fields

  1. <Field name="fieldName1" mdc="name of the MDC entry" ></Field>

Dynamic MDC Fields

  1. <DynamicMdcFields regex="mdc.*" ></DynamicMdcFields>

In contrast to the configuration of other log frameworks log4j2 config uses one DynamicMdcFields element per regex (not separated by comma).

Log-Event fields

See also: Pattern Layout

Set the desired pattern and the field will be sent using the specified pattern value.

Additionally, you can add the host-Field, which can supply you either the FQDN hostname, the simple hostname or the local address.

Option Description
host{[“fqdn”
“simple”
“address”]}		 Outputs either the FQDN hostname, the simple hostname or the local address. You can follow the throwable conversion word with an option in the form %host{option}.
%host{fqdn} default setting, outputs the FQDN hostname, e.g. www.you.host.name.com.
%host{simple} outputs simple hostname, e.g. www.
%host{address} outputs the local IP address of the found hostname, e.g. 1.2.3.4 or affe:affe:affe::1.

XML

  1. <Configuration packages="biz.paluch.logging.gelf.log4j2">
  2.     <Appenders>
  3.         <Gelf name="gelf" host="udp:localhost" port="12201" version="1.1" extractStackTrace="true"
  4.               filterStackTrace="true" mdcProfiling="true" includeFullMdc="true" maximumMessageSize="8192"
  5.               originHost="%host{fqdn}" additionalFieldTypes="fieldName1=String,fieldName2=Double,fieldName3=Long">
  6.             <Field name="timestamp" pattern="%d{dd MMM yyyy HH:mm:ss,SSS}" ></Field>
  7.             <Field name="level" pattern="%level" ></Field>
  8.             <Field name="simpleClassName" pattern="%C{1}" ></Field>
  9.             <Field name="className" pattern="%C" ></Field>
  10.             <Field name="server" pattern="%host" ></Field>
  11.             <Field name="server.fqdn" pattern="%host{fqdn}" ></Field>
  13.             <!-- This is a static field -->
  14.             <Field name="fieldName2" literal="fieldValue2" ></Field>
  16.             <!-- This is a field using MDC -->
  17.             <Field name="mdcField2" mdc="mdcField2" ></Field> 
  18.             <DynamicMdcFields regex="mdc.*" ></DynamicMdcFields>
  19.             <DynamicMdcFields regex="(mdc|MDC)fields" ></DynamicMdcFields>
  20.             <DynamicMdcFieldType regex="my_field.*" type="String" ></DynamicMdcFieldType>
  21.         </Gelf>
  22.     </Appenders>
  23.     <Loggers>
  24.         <Root level="INFO">
  25.             <AppenderRef ref="gelf" ></AppenderRef>
  26.         </Root>
  27.     </Loggers>
  28. </Configuration>

YAML

  1. rootLogger:
  2.     level: INFO
  3.     appenderRef.gelf.ref: GelfAppender
  5. appender.gelf:
  6.     type: Gelf
  7.     name: GelfAppender
  8.     host: udp:localhost
  9.     port: 12201
  10.     version: 1.0
  11.     includeFullMdc: true
  12.     mdcProfiling: true
  13.     maximumMessageSize: 32768
  14.     dynamicMdcFields:
  15.         type: DynamicMdcFields
  16.         regex: "mdc.*,(mdc|MDC)fields"
  17.     field:
  18.         - name: fieldName2
  19.           literal: fieldName2 # This is a static field
  20.         - name: className
  21.           pattern: "%C"
  22.         - name: lineNumber
  23.           pattern: "%line"

JBoss AS7 configuration

Include the library as module (see download above), then add following lines to your configuration:

standalone.xml

  1. <custom-handler name="GelfLogger" class="biz.paluch.logging.gelf.jboss7.JBoss7GelfLogHandler" module="biz.paluch.logging">
  2.     <level name="INFO" ></level>
  3.     <properties>
  4.         <property name="host" value="udp:localhost" ></property>
  5.         <property name="port" value="12201" ></property>
  6.         <property name="version" value="1.1" ></property>
  7.         <property name="facility" value="java-test" ></property>
  8.         <property name="extractStackTrace" value="true" ></property>
  9.         <property name="filterStackTrace" value="true" ></property>
  10.         <property name="mdcProfiling" value="true" ></property>
  11.         <property name="timestampPattern" value="yyyy-MM-dd HH:mm:ss,SSS" ></property>
  12.         <property name="maximumMessageSize" value="8192" ></property>
  14.         <!-- This are static fields -->
  15.         <property name="additionalFields" value="fieldName1=fieldValue1,fieldName2=fieldValue2" ></property>
  16.         <!-- Optional: Specify field types -->
  17.         <property name="additionalFieldTypes" value="fieldName1=String,fieldName2=Double,fieldName3=Long" ></property>
  19.         <!-- This are fields using MDC -->
  20.         <property name="mdcFields" value="mdcField1,mdcField2" ></property>
  21.         <property name="dynamicMdcFields" value="mdc.*,(mdc|MDC)fields" ></property>
  22.         <property name="dynamicMdcFieldTypes" value="my_field.*=String,business\..*\.field=double" ></property>
  23.         <property name="includeFullMdc" value="true" ></property>
  24.     </properties>
  25. </custom-handler>
  27. ...
  29. <root-logger>
  30.     <level name="INFO"></level>
  31.     <handlers>
  32.         <handler name="FILE"></handler>
  33.         <handler name="CONSOLE"></handler>
  34.         <handler name="GelfLogger"></handler>
  35.     </handlers>
  36. </root-logger>

WildFly configuration

Include the library as module (see download above). Place it below the $JBOSS_HOME/modules/system/layers/base path, then add following lines to your configuration:

standalone.xml

  1. <custom-handler name="GelfLogger" class="biz.paluch.logging.gelf.wildfly.WildFlyGelfLogHandler" module="biz.paluch.logging">
  2.     <level name="INFO" ></level>
  3.     <properties>
  4.         <property name="host" value="udp:localhost" ></property>
  5.         <property name="port" value="12201" ></property>
  6.         <property name="version" value="1.1" ></property>
  7.         <property name="facility" value="java-test" ></property>
  8.         <property name="extractStackTrace" value="true" ></property>
  9.         <property name="filterStackTrace" value="true" ></property>
  10.         <property name="mdcProfiling" value="true" ></property>
  11.         <property name="timestampPattern" value="yyyy-MM-dd HH:mm:ss,SSS" ></property>
  12.         <property name="maximumMessageSize" value="8192" ></property>
  14.         <!-- This are static fields -->
  15.         <property name="additionalFields" value="fieldName1=fieldValue1,fieldName2=fieldValue2" ></property>
  16.         <!-- Optional: Specify field types -->
  17.         <property name="additionalFieldTypes" value="fieldName1=String,fieldName2=Double,fieldName3=Long" ></property>
  19.         <!-- This are fields using MDC -->
  20.         <property name="mdcFields" value="mdcField1,mdcField2" ></property>
  21.         <property name="dynamicMdcFields" value="mdc.*,(mdc|MDC)fields" ></property>
  22.         <property name="dynamicMdcFieldTypes" value="my_field.*=String,business\..*\.field=double" ></property>
  23.         <property name="includeFullMdc" value="true" ></property>
  24.     </properties>
  25. </custom-handler>
  27. ...
  29. <root-logger>
  30.     <level name="INFO"></level>
  31.     <handlers>
  32.         <handler name="FILE"></handler>
  33.         <handler name="CONSOLE"></handler>
  34.         <handler name="GelfLogger"></handler>
  35.     </handlers>
  36. </root-logger>

Thorntail (WildFly Swarm 2.x) configuration

Include module-thorntail.xml from the logging module zip (see download above). Place it below the src/main/resources/modules/biz/paluch/logging/main path as module.xml, then add following lines to your project-stages.yml:

project-stages.yml:

  1. swarm:
  2.   logging:
  3.     custom-handlers:
  4.       GelfLogger:
  5.         attribute-class: biz.paluch.logging.gelf.wildfly.WildFlyGelfLogHandler
  6.         module: biz.paluch.logging
  7.         properties:
  8.             host: "udp:localhost"
  9.             port: 12201
  10.             version: "1.0"
  11.             facility: "java-test"
  12.             extractStackTrace: true
  13.             filterStackTrace: true
  14.             includeLocation: true
  15.             mdcProfiling: true
  16.             timestampPattern: "yyyy-MM-dd HH:mm:ss,SSS"
  17.             maximumMessageSize: 8192
  18.             additionalFields: "fieldName1=fieldValue1,fieldName2=fieldValue2"
  19.             additionalFieldTypes: "my_field.*=String,business\..*\.field=double"
  20.             MdcFields: "mdcField1,mdcField2"
  21.             dynamicMdcFields: "mdc.*,(mdc|MDC)fields"
  22.             includeFullMdc: true
  23.     root-logger:
  24.       level: INFO
  25.       handlers:
  26.       - GelfLogger

Logback GELF configuration

logback.xml Example:

  1. <!DOCTYPE configuration>
  3. <configuration>
  4.     <contextName>test</contextName>
  5.     <jmxConfigurator></jmxConfigurator>
  7.     <appender name="gelf" class="biz.paluch.logging.gelf.logback.GelfLogbackAppender">
  8.         <host>udp:localhost</host>
  9.         <port>12201</port>
  10.         <version>1.1</version>
  11.         <facility>java-test</facility>
  12.         <extractStackTrace>true</extractStackTrace>
  13.         <filterStackTrace>true</filterStackTrace>
  14.         <mdcProfiling>true</mdcProfiling>
  15.         <timestampPattern>yyyy-MM-dd HH:mm:ss,SSS</timestampPattern>
  16.         <maximumMessageSize>8192</maximumMessageSize>
  18.         <!-- This are static fields -->
  19.         <additionalFields>fieldName1=fieldValue1,fieldName2=fieldValue2</additionalFields>
  20.         <!-- Optional: Specify field types -->
  21.         <additionalFieldTypes>fieldName1=String,fieldName2=Double,fieldName3=Long</additionalFieldTypes>
  23.         <!-- This are fields using MDC -->
  24.         <mdcFields>mdcField1,mdcField2</mdcFields>
  25.         <dynamicMdcFields>mdc.*,(mdc|MDC)fields</dynamicMdcFields>
  26.         <dynamicMdcFieldTypes>my_field.*=String,business\..*\.field=double</dynamicMdcFieldTypes>
  27.         <includeFullMdc>true</includeFullMdc>
  28.         <filter class="ch.qos.logback.classic.filter.ThresholdFilter">
  29.             <level>INFO</level>
  30.         </filter>
  31.     </appender>
  33.     <root level="DEBUG">
  34.         <appender-ref ref="gelf" ></appender-ref>
  35.     </root>
  36. </configuration>

License

Contributing

Github is for social coding: if you want to write code, I encourage contributions through pull requests from forks of this repository.
Create Github tickets for bugs and new features and comment on the ones that you are interested in and take a look into CONTRIBUTING.md