Packages

  • package root
    Definition Classes
    root
  • package io
    Definition Classes
    root
  • package dylemma
    Definition Classes
    io
  • package spac

    SPaC (short for "Streaming Parser Combinators") is a library for building stream consumers in a declarative style, specialized for tree-like data types like XML and JSON.

    SPaC (short for "Streaming Parser Combinators") is a library for building stream consumers in a declarative style, specialized for tree-like data types like XML and JSON.

    Many utilities for handling XML and JSON data involve parsing the entire "document" to some DOM model, then inspecting and transforming that model to extract information. The downside to these utilities is that when the document is very large, the DOM may not fit in memory. The workaround for this type of problem is to treat the document as a stream of "events", e.g. "StartElement" and "EndElement" for XML, or "StartObject" and "EndObject" for JSON. The downside to this workaround is that writing code to handle these streams can be complicated and error-prone, especially when the DOM is complicated.

    SPaC's goal is to drastically simplify the process of creating code to handle these streams.

    This package contains the "core" SPaC traits; Parser, Transformer, Splitter, and ContextMatcher.

    See the xml and json subpackages (provided by the xml-spac and json-spac libraries respectively) for specific utilities related to handling XML and JSON event streams.

    Definition Classes
    dylemma
  • package json

    This package provides extensions to the core "spac" library which allow for the handling of JSON data.

    This package provides extensions to the core "spac" library which allow for the handling of JSON data.

    Rather than creating explicit classes that extend Parser, Transformer, and Splitter, this package provides type aliases and implicit extensions. For example, JsonParser[A] is just a type alias for Parser[JsonEvent, A], and JsonParser is just a call to Parser[JsonEvent].

    Implicit JsonParsers are available for each of the JSON primitive types:

    • string
    • number (expressed as Int, Long, Float, or Double)
    • boolean
    • null (expressed as None.type)

    Helpers are available for parsing JSON arrays and objects:

    • JsonParser.listOf[A] to parse an array where each value is an A
    • JsonParser.objectOf[A] to parse an object where the value for each field an A
    • JsonParser.objectOfNullable[A] to parse an object where the value for each field is either null or an A, filtering out the nulls
    • JsonParser.fieldOf[A](fieldName) to parse a specific field from an object

    A DSL for creating json-specific ContextMatchers is provided to make it more convenient to call Splitter.json. For example:

    Splitter.json("foo" \ "bar").as[String].parseFirst

    Can be used to capture rootJson.foo.bar as a String in

    {
      "foo": {
        "bar": "hello"
      }
    }

    To "split" values inside arrays, index-related context matchers are available, e.g.

    Splitter.json("foo" \ anyIndex).as[Int].parseToList

    Can be used to capture each of the numbers in the "foo" array in

    {
      "foo": [1, 2, 3]
    }

    A note about JsonEvents in spac: JSON doesn't have any explicit markers for when a field ends, or when an array index starts or ends; those context changes are essentially inferred by the presence of some other event. For example, instead of a "field end" event, typically there will be either a new "field start" or a token representing the end of the current object. With spac, splitters and context matchers generally operate under the assumption that a "stack push" event (like a field start) will eventually be followed by a corresponding "stack pop" event (i.e. field end).

    To allow for this, these "inferred" events (FieldEnd, IndexStart, IndexEnd) are explicitly represented as JsonEvents in the stream being parsed. Keep this in mind when creating JSON ContextMatchers:

    • field-related matchers will match a stack like case ObjectStart :: FieldStart(_) :: _
    • index-related matchers will match a stack like case ArrayStart :: IndexStart(_) :: _
    Definition Classes
    spac
  • Fs2DataSource
  • JacksonSource
  • JsonEvent
  • JsonParserApplyOps
  • JsonSplitterApplyOps
  • JsonSplitterOps
  • JsonStackElem
  • JsonStackPop
  • JsonValueEvent
o

io.dylemma.spac.json

JacksonSource

object JacksonSource

Provides helpers for creating fs2.Stream and Iterator instances of JsonEvent from various underlying event sources, using the Jackson library as the underlying event parser.

The helpers in this object operate in terms of the IntoJacksonJsonParser typeclass, which defines logic for using a source value to construct a Jackson JsonParser in a Resource. From there, the helpers take care of converting the jackson parser/event model to the spac JsonEvent model.

For example:

val file = new File("./stuff.json")
val jsonStream: Stream[IO, JsonEvent] = JacksonSource[IO](file)
Source
JacksonSource.scala
Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. JacksonSource
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def apply(jacksonParser: com.fasterxml.jackson.core.JsonParser): Source[JsonEvent]

    Wrap an existing Jackson JsonParser as a single-use source of JsonEvents.

    Wrap an existing Jackson JsonParser as a single-use source of JsonEvents.

    The source will *not* attempt to close the underlying parser.

    jacksonParser

    A Jackson JsonParser

    returns

    A single-use JSON event source

  5. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  6. def clone(): AnyRef
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @native()
  7. lazy val defaultFactory: JsonFactory

    Default JsonFactory used by the helpers in this object when interfacing with the IntoJacksonJsonParser typeclass to create the underlying Jackson JsonParsers.

    Default JsonFactory used by the helpers in this object when interfacing with the IntoJacksonJsonParser typeclass to create the underlying Jackson JsonParsers.

    This is a new JsonFactory with no additional modifications.

  8. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  9. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable])
  11. def fromFile(file: File, factory: JsonFactory = defaultFactory): Source[JsonEvent]

    Creates a new Source that reads JsonEvents from the given file.

    Creates a new Source that reads JsonEvents from the given file.

    file

    A JSON file

    factory

    A Jackson JsonFactory used to construct the underlying JsonParser for the string

    returns

    A reusable JSON event source

  12. def fromInputStream(stream: InputStream, factory: JsonFactory = defaultFactory): Source[JsonEvent]

    Wrap an InputStream as a single-use source of JsonEvents.

    Wrap an InputStream as a single-use source of JsonEvents.

    The Source will *not* attempt to close the input stream.

    stream

    An InputStream over raw JSON bytes

    factory

    A Jackson JsonFactory used to construct the underlying JsonParser for the string

    returns

    A single-use JSON event source

  13. def fromReader(reader: Reader, factory: JsonFactory = defaultFactory): Source[JsonEvent]

    Wrap a Reader as a single-use source of JsonEvents.

    Wrap a Reader as a single-use source of JsonEvents.

    The Source will *not* attempt to close the reader.

    reader

    A Reader over characters of raw JSON

    factory

    A Jackson JsonFactory used to construct the underlying JsonParser for the string

    returns

    A single-use JSON event source

  14. def fromString(rawJson: String, factory: JsonFactory = defaultFactory): Source[JsonEvent]

    Wrap a string of raw JSON as a source of JsonEvents

    Wrap a string of raw JSON as a source of JsonEvents

    rawJson

    A string containing raw JSON

    factory

    A Jackson JsonFactory used to construct the underlying JsonParser for the string

    returns

    A reusable JSON event source

  15. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  16. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  17. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  18. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  19. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  20. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  21. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  22. def toString(): String
    Definition Classes
    AnyRef → Any
  23. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  24. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  25. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()

Inherited from AnyRef

Inherited from Any

Ungrouped