{"id":356,"date":"2022-08-11T10:17:07","date_gmt":"2022-08-11T09:17:07","guid":{"rendered":"https:\/\/www.swissbyte.com\/en\/?page_id=356"},"modified":"2022-08-11T10:22:06","modified_gmt":"2022-08-11T09:22:06","slug":"smf2elk","status":"publish","type":"page","link":"https:\/\/www.swissbyte.com\/en\/index.php\/smf2elk\/","title":{"rendered":"SMF2ELK"},"content":{"rendered":"

[et_pb_section fb_built=”1″ fullwidth=”on” _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_fullwidth_header title=”Product – SMF2ELK” header_scroll_down=”on” _builder_version=”4.16″ _module_preset=”default” title_font=”|700|||||||” title_text_align=”center” background_image=”https:\/\/www.swissbyte.com\/en\/wp-content\/uploads\/2021\/11\/working-on-macbook-and-iphone-in-a-bed-picjumbo-com-night-scaled.jpg” custom_padding=”120px||120px||true|false” global_colors_info=”{}” theme_builder_area=”post_content”][\/et_pb_fullwidth_header][\/et_pb_section][et_pb_section fb_built=”1″ _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_row _builder_version=”4.16″ _module_preset=”default” min_height=”320.8px” custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.17.6″ _module_preset=”default” hover_enabled=”0″ global_colors_info=”{}” theme_builder_area=”post_content” sticky_enabled=”0″]<\/p>\n

SMF Realtime Data Feed to Elastic Search<\/strong><\/h1>\n

<\/strong><\/h4>\n

Functionality<\/strong><\/h3>\n

SMD2ELK can read SMF data directly in realtime from the logstream. Of course this SMF data can also be read from an SMF Unload Dataset.<\/p>\n

This data is then split into individual fields, enriched with master data and then written directly to Elastic Search via a web service. During this process, over 1000 additional fields are also calculated from the raw data (e.g. CPU usage in %).<\/p>\n

After a delay of about 5 seconds, the data is available in Elastic Search and can be analyzed via Kibana.<\/p>\n

\u00a0Data quality<\/h3>\n

To ensure that the data is never written twice in Elastic Search we have programmed a sophisticated mechanism. This mechanism runs completely automatically and does not require any further programming or definitions from the user side. If, for example, a processing step breaks off, it can simply be restarted at the start of the dataset.<\/p>\n

<\/h4>\n

 <\/p>\n

[\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row _builder_version=”4.17.6″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”4.17.6″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_image src=”https:\/\/www.swissbyte.com\/en\/wp-content\/uploads\/2022\/08\/SMF2Elk-Overview-Skizze-1.png” title_text=”SMF2Elk Overview Skizze” align=”center” _builder_version=”4.17.6″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][\/et_pb_image][\/et_pb_column][\/et_pb_row][et_pb_row _builder_version=”4.17.6″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”4.17.6″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.17.6″ _module_preset=”default” hover_enabled=”0″ global_colors_info=”{}” theme_builder_area=”post_content” sticky_enabled=”0″]<\/p>\n

The following SMF records are supportedt<\/h3>\n
    \n
  • 0, 2, 3, 6, 7<\/span><\/li>\n
  • 14, 15, 17, 18 Dataset Activity<\/span><\/li>\n
  • 21, 26,<\/span><\/li>\n
  • 30 Job Activity<\/span><\/li>\n
  • 42, 50, 61, 65, 66<\/span><\/li>\n
  • 70, 71, 72, 73, 74, 75, 77, 78 RMF und WLM<\/span><\/li>\n
  • 88, 89<\/span><\/li>\n
  • 100, 101, 102 DB2<\/span><\/li>\n
  • 110 CICS<\/span><\/li>\n
  • 115, 116 MQ<\/span><\/li>\n
  • 113<\/span><\/li>\n<\/ul>\n

    <\/span>In total, these are over 17000 fields.<\/p>\n

    <\/span><\/p>\n

    z\/OS <\/span>Features<\/span> of SMF2ELK<\/span><\/h3>\n
      \n
    • 99% zAAP Enabled Workload<\/span><\/li>\n
    • native BSAM access f\u00fcr z\/OS Dataset, z.B. VBS Dataset<\/span><\/li>\n
    • Monitor Service runs as STC<\/span><\/li>\n
    • z\/OS Operator Command support<\/span><\/li>\n<\/ul>\n

      <\/span><\/p>\n

      <\/h6>\n

      <\/span><\/p>\n

      [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row _builder_version=”4.17.6″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”4.17.6″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_button button_url=”https:\/\/nextstride.com\/” url_new_window=”on” button_text=”More about SMF2ELK at our partner site” _builder_version=”4.17.6″ _module_preset=”default” hover_enabled=”0″ global_colors_info=”{}” theme_builder_area=”post_content” sticky_enabled=”0″][\/et_pb_button][\/et_pb_column][\/et_pb_row][et_pb_row _builder_version=”4.17.6″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”4.17.6″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.17.6″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

      <\/h4>\n

      <\/span><\/p>\n

      IBM, the IBM logo, IBM Cloud, IBM z16, IBM Z, Telum and z\/OS are trademarks or registered trademarks of International Business Machines Corporation, in the United States and\/or other countries.<\/span><\/p>\n

      [\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":"

      SMF Realtime Data Feed to Elastic Search Functionality SMD2ELK can read SMF data directly in realtime from the logstream. Of course this SMF data can also be read from an SMF Unload Dataset. This data is then split into individual fields, enriched with master data and then written directly to Elastic Search via a web […]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_et_pb_use_builder":"on","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"class_list":["post-356","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/www.swissbyte.com\/en\/index.php\/wp-json\/wp\/v2\/pages\/356","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.swissbyte.com\/en\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.swissbyte.com\/en\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.swissbyte.com\/en\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.swissbyte.com\/en\/index.php\/wp-json\/wp\/v2\/comments?post=356"}],"version-history":[{"count":3,"href":"https:\/\/www.swissbyte.com\/en\/index.php\/wp-json\/wp\/v2\/pages\/356\/revisions"}],"predecessor-version":[{"id":361,"href":"https:\/\/www.swissbyte.com\/en\/index.php\/wp-json\/wp\/v2\/pages\/356\/revisions\/361"}],"wp:attachment":[{"href":"https:\/\/www.swissbyte.com\/en\/index.php\/wp-json\/wp\/v2\/media?parent=356"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}